This website uses cookies to ensure you have the best experience. Learn more

Moving Data To The Cloud Assignment

2990 words - 12 pages

1 Introduction 1
2 The Simple Case Study 1
2.1 Understanding the data 2
2.2 From Excel to CSV 3
2.2.1 Separating the single column into multiple data columns or fields 3
2.2.2 Practice Activity 1 5
3 Working with the Comma Separated Values File 7
3.1 What is a CSV File? 7
3.2 From Excel to CSV 7
3.3 Watch out for the CSV Gotchas 8
4 Moving Data to the Google Cloud Platform 9

Introduction
The supporting files needed for these exercise can be found in Blackboard.
The purpose of this exercise to gain experience in using some of the techniques available to database professionals, to help them move data from one place to another.
When dealing with actual data it is all too easy to forget that each row is potentially as important as the others. Our task is not only to move the data, but to move it accurately. Indeed, in some circumstances, the data we are provided with is itself unclean. We therefore need to ensure we understand the data we are dealing with and that when it completes its journey it is a valid and exact representation of the information being stored.
The Simple Case Study
This set of exercises is set in the context of a simple case study based around a fictional organisation called The North Yorkshire Classical CD Society. It is a non-profit organisation which buys CDs for use by its members. It was formed in 1991, when CDs were generally more expensive to buy, but although membership has not been increasing over the past few years, there is a solid base of loyal members who benefit from the service offered.
CD Data was formerly held only in spreadsheets, but the business case to move to an MySQL database hosted on the Google Cloud Platform has been made. The design decisions have already been taken and our task here is to populate two tables within the database with the existing Excel data.
The partial Class Diagram below describes the entities and their relationship:

Understanding the data
Each CD is assumed to have a primary COMPOSER. That is the person who wrote the piece in the TITLE field. The Title may consist of one or more pieces of music. The music is played by an ORCHESTRA which has CONDUCTOR in charge of it.
In the design phase it has been established that there is a need for a separate table which contains composers, and that every entry in the CD master file must be for a composer that exists in the COMPOSERS table.
The format in which this data is stored in the Excel is discussed later.
It is always sensible to try and understand the data you are moving around.
BEWARE: There has been very little data validation carried out up until now. The data that has been kept in the spreadsheet is far from perfect. There are quite a few records that have been incorrectly entered. For example, the Orchestra and Conductor fields are occasionally input in the wrong order.
From Excel to CSV
Many of the string handling functions within Excel can help in making sense of the data.
TIP: ALWAYS, ALWAYS,...

Find Another Essay On Moving Data to the Cloud - assignment

Moving to the Land of the Free

1228 words - 5 pages is a massive undertaking just to produce the record in this one case” (DeYoung Finn). This process will take more then just a few month so until then, the prisoners should be moved somewhere safe and secure until their trials. Another reason for moving the prisoners is the claims from many of them saying that abuse and torture at Guantanamo are habitual. Three of the prisoners, Rhuhel Ahmed, Shafiq Rasul, and Asif Iqbal were all captured

The Transition to Complex Societies: Moving Forward

2404 words - 10 pages . Weather, climate, or disease could ravage a hunter-gatherers food source, and, although this way of life was relatively stable over long periods of time, a population could be wiped out. The population of a hunter-gatherer society, therefore, was limited due to the fact that large amounts of food were not always available. In addition, they were always moving from place to place, and moving an extremely tribe was near impossible. Also

Moving to the United States from Israel: Personal Essay

871 words - 4 pages first and biggest obstacle was learnIng EnglIsh. I came here not knowIng any EnglIsh only Hebrew and Spanish. I was afraId that when I started school,no one would understand me not adults or kids. I was afraid I wouldn't be able to make any frIends, because of the language barrier, which made me really nervous about moving here. I was also afraid that I wouldn't know any of the AmerIcan manners, like saying "please", "thank you", "sorry" and

The Cheese Is Moving: Help Me to Change!

1531 words - 6 pages a Scurry aspect. One colleague, a fellow soldier, jumps to mind. This fellow followed a gradual course of promotion to an intermediate rank and then stalled in his career. Promotion was the cheese he saw moving away. He knew all the things he could do to get new cheese but would not act on them. The author encountered an example of the Hem character in the form of a gentleman we will refer to as CB. CB was anecdotal as an example of the

Moving to the Girl’s Side of ‘Hills like White Elephants

1906 words - 8 pages relationship at toll as well, Hemingway ends the story without the readers knowing what happens with the abortion and the relationship as well. David Wyche, Timothy O’Brien, and Stanley Renner compose articles to try to answer readers’ unanswered questions. Renner in his article, “Moving to the Girl’s Side of ‘Hills like White Elephants,’” states that the question in the movement of the characters as Jig struggles to find her own identity, leading her

Analysis of the Target Data Breach - ENG 1303 - Assignment

1706 words - 7 pages cards not taking in consideration the people working at that time that have to do OT and even opening branches for the same matter. From people’s perspective and what we were able to study, the target breach experience multiple factors that led to the Data Loss, malware attacks, phishing on vendors and POS that were exposed to memory scraping malwares with low strategies on how to detect those kind of situations that overall led to one of the most

The Importance of Big Data to Business

900 words - 4 pages Why Big-Data is important Why is Data is important for a company? What are the effects? Competitive advantage: All companies obtain information on their customers or on their product. All these information may help a business to develop new strategies. They can also forge ahead by treating these big data. All companies have in their possession those information, so use it can be very useful. A company can identify for example their

Cloud Computing Virtualization – A Threat to Security of the System

2040 words - 9 pages The main aim of this paper is to study the concept of cloud computing through virtualization, how security is compromised in cloud computing and how we can secure the system from security breach in case of virtualization. Keywords: cloud computing, Hypervisor, Virtual machine, Virtualization Security. 1. INTRODUCTION Cloud computing is a model for enabling convenient, on demand network access to a shared pool of configurable computing

Moving to USA The journey of my life began - CCM/English Comp 1 - Essay

834 words - 4 pages The journey of my life began ten years ago when I moved to United States with my family. I was born in India and I never thought about moving to America. My parents said that moving to America is going to be the best thing for all of us. But, in reality it was going to be so difficult for me personally because I didn't know how to speak English. Furthermore, I didn't have any family or friends in America. Lastly, there were so many new faces and

This Essay Is About The Effects Of Moving To A New Place

299 words - 2 pages amongst the neighbors. One has an epiphany moving to a city, realizing that all the millions of people who live there are strangers, and that one coming from a small town can never trust just anyone. Growing up knowing everyone's name and their personalities is a great difference from not even knowing your next-door neighbor. The sense of security is now broken completely.School is a completely different matter. Even though math and science seem

The Application of Social and Emotional Theory: Moving to a Retirement Village

1699 words - 7 pages ; Berk, 2010). In Jean’s case, moving to a retirement village generated both feelings of despair, and ultimately integrity. She worried about her ability to look after Frank, and who would eventually take care of them both. Furthermore, Jean did not want to burden their children with their care. In fact, these are all too common concerns shared by those in late adulthood (Berk, 2010). The stress of prying Frank away from the farm was

Similar Essays

Store Your Data In The Cloud

1809 words - 8 pages computer anywhere in the world, with an Internet connection. Cloud storage needs hosting companies to operate a large data centers, and people who require their data to be hosted a data storage capacity from them. That can be access using public network or WAN (Wide Area Network). How it cloud storage works? In modern technology, the number of files and document are keep growing until no space to store. That’s the idea

Cloud Auditing For The Data Integrity

617 words - 3 pages Methodologies: This section explain the actual working of the system which includes the important function like tag generation and techniques of auditing like simple auditing, dynamic auditing, batch auditing with support of multi-cloud as well as multi-user. Block Size: The size of block plays a vital role in time consumption and security of data. Previously 20 Kb per block was considered which took near about 55 seconds for 5.10MB, more

Adoption Of Cloud Computing Relating To Data Storage

2267 words - 9 pages The main driving forces of cloud data storage are reputable companies such as Amazon and Google building comprehensive computing infrastructures (Google, 2009). These infrastructures are removing the complexity of in-house data storage and ultimately reducing costs of limited networked data centres (Hitachi, 2010). The traditional inefficient model of purchasing servers every time you need to accommodate for high use or growth is now being

Retrieving The Top K Ranked Secure Sensor Data In Cloud

762 words - 4 pages - With the advent of cloud computing, publishers are motivated to store their complex data management systems from local sites to public cloud for greater flexibility and economic savings. But for protecting data privacy, and also to avoid information leakage, sensed data have to be encrypted before outsourcing onto the cloud servers. Considering the huge number of data users and documents in cloud, it is critical for the search service to