IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 392- 397

International Journal of Research in Information Technology (IJRIT)

www.ijrit.com

ISSN 2001-5569

Data Migration System in Heterogeneous Database Shashikant Patel*,SagarWakchaure**,MahendraPingale**Prof. Saba Siraj

*(IOK-COE, Pune University, India Email: [email protected])

*(IOK-COE, Pune University, India Email: [email protected])

*(IOK-COE, Pune University, India Email: [email protected])

ABSTRACT With information becoming an increasingly valuable corporate asset, today's IT organizations need the right tools to store, manage, and move that information in the most reliable and cost efficient manner. As part of an Information Lifecycle Management (ILM) best-practices strategy, organizations require innovative solutions for migrating data between storage systems, especially in heterogeneous environments. To support this need, we as planed to design a powerful tool that enables affordable, highperformance data migration in a wide range of storage environments. This project is the unique challenges of data migration in dynamic IT environments and the key business advantages that we have designed to provide over traditional tools used for migration. Keywords: - Data Migration, Database, Design. Data Migration : Data migrations generally result from the introduction of a new system. This may involve an application migration or consolidation in which one or more legacy systems are replaced or the deployment of an additional system that will sit along-side the existing applications. Database : Database is collection of inter-related data. Design: Design is template or pattern to describe the something.

Shashikant Patel, IJRIT

392

IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 392- 397

1. INTRODUCTION There are data migrated in the old system manually. The cost and error ratio of these approach are relatively high. Typically, these data are those necessary for the new system while the old systems cannot provides.. A "Database Migrator" is usually developed for individuals and organizations to save time for converting to a new database if a database already exists. Instead of creating all the tables etc. of the already existing database, one can simply use the software to convert it into new database, if required. It can also be used by organizations that deal with complex data import, export and migration issues. After all, importing, exporting or migrating data between different sources is very complicated and time consuming especially if these data sources store data in different formats.

2. LITERATURE REVIEV Issues concerning the transference of data from existing databases to other applications are discussed. The process of transferring data is called data migration, and it is divided into two processes extracting data from existing systems in the form of an extracted file, and loading data from the extracted file into the new application. The new application usually requires data in different formats, and so transformation of data is generally needed. Moreover, the new application frequently requires data from more than one source database system, so integration of data is necessary in the migration process.

2. SYSTEM ARCHITECTURE

Fig: System Architecture

Step 1 - The user is provided with the login facility. The user will first enter its username and password which are encrypted in our coding. The user’s entered information is validated.

Shashikant Patel, IJRIT

393

IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 392- 397

Step 2 - The user is then asked to select the source database which is to be migrated. The source database consists of Access, SQL Server and Oracle.

Step 3 - After the connection is tested the user is asked to select the destination database to which the migration will take place. After selecting the destination database the user has to fill the details of the selected destination database to create the connection.

Step 4 - The user is asked to select the tables, columns of the table, views which are to be migrated.

Shashikant Patel, IJRIT

394

IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 392- 397

Step 5 - the user is also provided with the facility to select either the schema of the table or rows of the table along with the constraints which are applied to the tables.

Step 6 - Click start migration button to start the migration. After the complete and successful migration of source database to destination database it displays the status report of the complete migration process.

Shashikant Patel, IJRIT

395

IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 392- 397

3. OBJECTIVES 1)Migration of source databases schema to the destination database. 2)Then follows the migration of tables to the destination database. 3)And then it is topped by the actual migration of data from source to destination database. 4)To prompt the user to select the source database and destination database. Connections for source and destination are tested. 5)Tree view structure is designed to enable the user to select and deselect tables, views for migration from source structure to the target structure. 6)This form will display a summary of all the selected items. User is allowed to select constraints to be applied such as primary key, foreign key and unique key.

4. METHODOLOGY In this approach, following factors that affect the Component Selection Efforts havebeen proposed. Portability : This factor is defined as the ability of a component to be transferred from on environment to another with little modifications, if required. Functionality: Functionality of a component depends upon the number of functions and their properties in these functions. Security :The primary goals of software security are the preservation of the confidentiality, integrity, and availability of the information assets and resources that the software creates, stores, processes, or transmit, including the executing programs themselves

. 5. SCOPE The purpose of the project keeps the scope of project limited to following categories. They are: 1)The initial part deals with conventional migration keeping in mind i.e. we strictly adhere to the definition that the source of data to be migrated is a database and the destination is also a database .While doing so the only part that undergoes any visible change is the structure of the source and destination database while all the data, attributes, table name etc remains unaffected.. 2)The next part deals with migrating Tables applying constraints such as primary key,foreign key, unique key, index key and check constraints. Migrations of views are also supported. 3)We have also provided facility for selecting and deselecting the fields of a table or an entire table itself for migration. The mapping rules have been defined in an MS Access which is referenced by our migrator tool to map the various data types in the process of migration. After the migration has occurred a status report will be displayed which will indicate if the table schema is migrated, records are inserted, constraints like primary key, foreign key, unique key, check constraints have been migrated successfully or pending or failed.

6. ADVANTAGES OF PROPOSED SYSTEM •

Security: The application is such that it allows the authorized user.



Time efficient: Migrating every record manually would take quite a lot of time but using a migration tool would take the application few seconds to migrate from the specified source to the specified destination.

Shashikant Patel, IJRIT

396

IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 392- 397



Flexible: The inherent nature of this application is flexible. The initial concept of data migration that we have implemented on typical case of Access to Sql can be further extended to any source database and to any destination database.



Interactive: The highly interactive nature of this application ensures that minimum special training is required to handle it .

6. FUTURE WORK •

Scheduling :

One can migrate the data at any time. If you want to migrate the data at 5 o’clock then you can set the time. •

Migration can be done in small area network :

One can migrate the data in LAN or Wi-Fi.

7. CONCLUSION We know that various organizations use different type of databases to store their users information. If we want to use the existing databases of such organizations then we have to convert the database in the format which is compactable to our application. This database migration is achieved by database migration tool. A Database Migration Suite is usually developed for individuals and organizations to save time for converting to a new database if a database already exists. The purpose of our project is to migrate data from an existing database to another database. Our migrator tool provides source databases as MS Access, destination databases as SQL Server and Oracle. We also have implemented migration from SQL Server to Oracle and vice versa.

REFERENCES 1] Lixian Xing, Yanhong Li, "Design and application of data migration system in heterogeneous database" in 2010 International Forum on Information Technology and applications. 2]"DATA MIGRATION BEST PRACTICES" App Global Services January 2006. 3] Microsoft CRM Data Migration Framework White Paper by ParulManek, Program Manager Published: April 2003. 4] Jaiwei Han, MichelinneKamber, "Data Mining: Concepts and Techniques." 5] Manjunath T.N, Ravindra S Hegadi, Ravikumar G K."A Survey on Multimedia Data Mining and Its Relevance Today" IJCSNS. Vol. 10 No. 11-Nov 2010, pp. 165-170. 6] Manjunath T.N, Ravindra S Hegadi, Ravikumar G K. "Analysis of Data Quality Aspects in at warehouse Systems", (IJCSIT)-Jan2011. 7] DATA Quality in health Care Data warehouse Environments Robert L. Leitheiser, University of WisconsinWhitepaper. 8] Potts, William J. E., (1997), Data Mining Using SAS Enterprise Miner Software. Cary, North Carolina: SAS Institute.

Shashikant Patel, IJRIT

397

Data Migration System in Heterogeneous Database

challenges of data migration in dynamic IT environments and the key business advantages that we have designed to ... involve an application migration or consolidation in which one or more legacy systems are replaced or .... Scheduling :.

1MB Sizes 5 Downloads 232 Views

Recommend Documents

Data Migration System in Heterogeneous Database - International ...
*(IOK-COE, Pune University, India. Email: [email protected]). ABSTRACT. With information becoming an increasingly valuable corporate asset, ...

Entity identification for heterogeneous database ...
Internet continuously amplifies the need for semantic ..... ing procedure of an application service provider. (ASP) for the .... ю 17:4604 В Home ю 14:9700 В Bus.

BARRIERS TO MIGRATION IN A SYSTEM OF CITIES The ... - UVic
anism to limit migration there is free mobility in the second stage. In equilibrium all ..... to allow the proximity of individuals to different cities both geographically and in preference-space to enter the model. ...... St. Cloud, MN. 167392. -0.0

BARRIERS TO MIGRATION IN A SYSTEM OF CITIES The ... - UVic
anism to limit migration there is free mobility in the second stage. In equilibrium all ..... to allow the proximity of individuals to different cities both geographically and in preference-space to enter the model. ...... St. Cloud, MN. 167392. -0.0

Spatially heterogeneous dynamics in a granular system ...
Dec 27, 2007 - system near jamming. A. R. Abate and D. J. Durian. University of Pennsylvania, Philadelphia, Pennsylvania 19104. (Received 23 August 2007; ...

Data Tiering in Heterogeneous Memory Systems
Apr 21, 2016 - DRAM 300-40 450-40 600-40 600-20 600-10 600-5 ... the others (with lower bandwidth requirement) are more sen- ...... expensive random dependent accesses that are common in ..... a Social Network or a News Media?

Evidence from Migration Data
sumption amenities and servicesFsometimes called the 'bright lights' hypothesis. (e.g. Henderson 1986). .... technical staff in the labour force over the last two decades. Thus, there is .... support for the view that large cities have higher shares

Database Management System - SVIT - Vasad
Basic Concepts : data, database, database systems, database management systems, instance, schema, Database ... Structure of Relational Databases (Basic Structure, Database Schema, Types of Keys),. Fundamental Relational Algebra ... Also, given a SQL

Dynamic Data Migration Policies for* Query-Intensive Distributed Data ...
∗Computer Science, Graduate School and University Center, City University ... dials a number to make a call, a request is made to query the callee's location.

An Energy-Efficient Heterogeneous System for ... - Semantic Scholar
IV, we describe the system architecture. In Section V, we present the performance characteristics of the workloads. In. Section VI, we evaluate the energy ...

An Energy-Efficient Heterogeneous System for ...
investigate the use of the Atom processor for web search ... accelerators, where the Atom functions as a host and control ... to extract K best .... operating at 10.

An Energy-Efficient Heterogeneous System for ...
Abstract—Embedded learning applications in automobiles, surveillance .... investigate the use of the Atom processor for web search ..... /products.php?pn=.

A shared file system abstraction for heterogeneous ...
process must pessimistically transfer all the data the ac- ..... mapping. Unfortunately GPU does not expose any pro- grammable virtual memory, thus requiring ...

Spatiotemporal Cooperation in Heterogeneous Cellular ...
required to harvest spatial diversity via joint transmission. In the low-coverage regime, on the other ... coverage as they suppress part of the interference power.

Measuring Domain Influence in Heterogeneous Networks
enhance influence analysis by providing subtle domain-level influence view, in this paper, ... heterogeneous online social networks, such as Twitter and Weibo, ..... famous professor on computer science in Tsinghua University; and this user ...

Measuring Domain Influence in Heterogeneous Networks
heterogeneous online social networks, such as Twitter and Weibo, ... further use spectral clustering [10] to generate domains. This integration of .... those sites.

Invasion Threshold in Heterogeneous Metapopulation ...
Oct 5, 2007 - to model a wide range of phenomena in chemistry and physics [11], and ... schemes and provide a framework for the analysis of realistic ...

Data collection system
272607221 A * 9/1996 vookket 411-1. , 87, 60 A * 12/1996 ... 9/1998 Schiltz et a1. . . . . . . ..... systems, however, are merely special purpose notebook computers ...

Heterogeneous peer effects in education
in friendship network topology between Wave I and Wave II, which enables us to distinguish between ... They estimate the model using a Bayesian approach.

Heterogeneous anchoring in dichotomous choice valuation framework
Flachaire E., Hollard, G. et Luchini S., Heterogeneous anchoring in dichotomous choice valuation framework,. Recherches ... the contingent valuation method in eliciting individual willingness to pay 1. In the dichotomous choice .... with a “missing

Measuring Domain Influence in Heterogeneous Networks
Ou Chen CEO of Jumei. 2060750830. Dr. Hang Li. 1355610915. Tao Jiang CSDN. 1896891963. Binxing Fang Beiyou Univ. 1355610915. Tao Jiang CSDN.

Transfer learning in heterogeneous collaborative filtering domains
E-mail addresses: [email protected] (W. Pan), [email protected] (Q. Yang). ...... [16] Michael Collins, S. Dasgupta, Robert E. Schapire, A generalization of ... [30] Daniel D. Lee, H. Sebastian Seung, Algorithms for non-negative matrix ...

Silberschatz - Database System Concepts, Fourth Edition.pdf ...
There was a problem previewing this document. Retrying... Download. Connect more apps... Try one of the apps below to open or edit this item. Silberschatz ...