INTERNATIONAL RESEARCH JOURNAL OF SCIENCE ENGINEERING AND TECHNOLOGY

( Online- ISSN 2454 -3195 ) New DOI : 10.32804/RJSET

Impact Factor* - 6.2311


**Need Help in Content editing, Data Analysis.

Research Gateway

Adv For Editing Content

   No of Download : 137    Submit Your Rating     Cite This   Download        Certificate

INCREMENTAL MINING AND INCREMENTAL LOADING OF LARGE DIMENSIONS IN A OPERATIONAL DATA SOURCE

    2 Author(s):  VANDANA TIWARI , P. K. RAI

Vol -  9, Issue- 4 ,         Page(s) : 6 - 11  (2019 ) DOI : https://doi.org/10.32804/RJSET

Abstract

Incremental reloading of warehouses is naturally synonymous with incremental maintenance of materialized views as both areas face the same problem – how to upgrade physically integrated information under a given time limit.Slow Changing Dimension (SCD) is a common term for techniques that track data sources to identify and capture data changes that are necessary. For training, various SCD methods are used. Data changes slowly with Slowly Changing Dimensions (SCDs) instead of changing on a regular schedule based on time. The advantage of this strategy is that it will hold two versions, the older version and the current version will have two files. One of the common problems of data storage is how changes can be treated if they occur in a particular field or feature in a particular database. We described three types of functional data source application: initial loading, incremental loading, and total refresh.

1. I. William, S. Derek, and N. Genia,DW 2.0: The Architecture for the Next Generation of Data Warehousing. Burlington, MA: Morgan Kaufman, 2008, pp. 215-229.
2. T. Palpanas, R. Sidle, R. Cochrane and H. Pirahesh, "Incremental Maintenance for Non-Distributive Aggregate Functions," in Proceedings of the 28th VLDB Conference, Hong Kong, 2002.
3. H. Gupta and I. S. Mumick, “Incremental Maintenance of Aggregate and Outerjoin Expressions,” Information Systems, pp. 435-464, 2006.
4. W. Liang, H. Wang and M. Orlowska, “Materialized view selection under the maintenance time constraint,” Data & Knowledge Engineering, vol. 37, pp. 203-216, 2001.
5. C. R. Valencio, M. H. Marioto, G. F. Donega Zafalon, J. M. Machado and J. C. Momente, “Real Time Delta Extraction Based on Triggers to Support Data Warehousing,” in International
Conference on Parallel and Distributed Computing, Applications and Technologies, 2013.
6. X. Zhang, W. Sun, W. Wang, Y. Feng and B. Shi , “Generating Incremental ETL Processes Automatically,” in Proceedings of the First International Multi-Symposiums on Computer and Computational Sciences (IMSCCS'06), 2006.
7. T. Jorg and S. Desloch, “Towards Generating ETL Processes for Incremental Loading,” in IDEAS08, Coimbra, Portugal, 2008.
8. S. Kozielski and R. Wrembel, New Trends in Data Warehousing and Data Analysis: Annals of Information Systems, vol. 3, Springer, 2008, pp. 19-49.
9. M. Bokun and C. Taglienti, “Incremental Data Warehouse Updates,” Information Management Magazine, 1998.
Book :
10. Kimball, R., Caserta, J.: The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, leaning,Conforming, and Delivering Data. John Wiley & Sons,2004.

*Contents are provided by Authors of articles. Please contact us if you having any query.






Bank Details