Data Warehousing
Data Warehouse technology has changed the way that global organizations conduct business. Many have found it impossible to create a business strategy without a data warehouse. The purpose of this discussion is to research and explain the importance of data warehouse management.
We will begin by defining data warehouse and describing the business uses for the technology. Our discussion will then focus of data warehouse management. We will examine the three components of data warehouse management. In addition, we will discuss the assurance of safety and privacy which are needed to maintain the integrity of the data warehouse. Our discussion will also focus on the availability and reliability of the data warehouse. We will also investigate different management tools that are used to maintain the data warehouse.
Definition of Data Warehouse is defined as "A Database system containing large amounts of data that uses sophisticated software optimized for fast searches and…...
mlaBibliography
Barker, Richard. (1998). "Managing and Data Warehouse." Veritas Software Corporation. http://www.keltec.co.uk/whitepaper/manage_datawarehouse.pdf
Compact American Dictionary of Computer Words. (1998) Houghton Mifflin Company
Data Warehousing." (2003). Information Builders. http://www.informationbuilders.com/definition/data-warehousing.html
The Quality Data Warehouse. (1999). SAS Institute. White Papers.
because the system is designed to be able to handle complex queries for information much faster than are traditional databases, designing and implementing such an attack becomes more difficult and complex (Warigon, 1997). At the same time, the ease with which information in a data warehouse can be manipulated creates more significant problems than a traditional database should unauthorized access be obtained (TechFaq, 2010). While no database or information system could possibly have all necessary security precautions embedded within the structure of its basic operations -- i.e. storing, classifying/analyzing, and retrieving data -- as it is simply not in the nature of an information system to provide such security, data warehouses are at a special level of risk due to the organization of data and the speed at which it is processed (TechFaq, 2010; Warigon, 1997).
Building effective security for a data warehouse can occur in a multitude of ways…...
mlaReferences
Nishith. (2005). Database vs. data warehouse. Accessed 19 December 2011. http://opensourceanalytics.com/2005/11/02/database-vs.-data-warehouse/
TechFaq. (2010). Data warehouse. Accessed 19 December 2011. http://www.tech-faq.com/data-warehouse.html
Warigon, S. (1997). Data warehouse control and security. Accessed 19 December 2011. http://all.net/books/audit/kits/dw.html
In addition, the support of multiple taxonomies is also critical for a data warehouse, and to the extent the architects have created a database architecture that will provide for metadata definition and re-defining of taxonomies is the extent to which the data warehouse will have greater use in the organization. Without a strong focus on these aspects of data agility, a data warehouse can quickly become outmoded and only marginally successful.
Assume that you are the data quality expert on the data warehouse project team for a large financial institution with many legacy systems dating back to the 1970s. Review the types of data quality problems you are likely to have and make suggestions on how to deal with those.
There are going to be a myriad of data quality problems inherent in managing the data quality inconsistencies with legacy systems dating back from the 1970s. Most significant and potentially problematic…...
Since poor data quality within a system often results in poor business decisions being made from this data, it is very important that each administrator or system architect look at each customer or end-user differently, in their own unique light. Since each end-user is different, and the needs of the customer often stem from the warehouse's ability to accurately store quality information, a system that dates back to the 1970's will likely have quite a few issues relative to functionality and compatibility with modern data warehousing and information delivery systems. A data warehouse will become obsolete if customers and end-users cannot trust that the data being stored is not "dirty." It is therefore important to start with the assumption that the data stored within a warehouse that leads back to legacy systems from the 1970's is corrupt.
It is also necessary, in these early stages, to ascertain the level of data…...
Data Warehousing and Mobile Computing
In the contemporary competitive environment, organizations are being forced to collect, store and analyze a large volume of data to make an analytical decision. However, business executives are faced with the time constraints when analyzing data, thus, data warehousing over the mobile computing have come into existing to assist in analyzing data quickly anywhere to assist in enhancing an effective timely decision. The study presents the literature reviews on the application of the data warehousing over the mobile computing. The study reveals that as firms are increasingly doing their businesses online, thus, storing and accessing data over the mobile devices are becoming a necessity. With the growth of the powerful laptop and internet, it is now possible to store a large volume of data in the mobile devices and cloud computing.
Introduction
Data warehousing is defined as the database system that organizations use for reporting and analysis. Typically,…...
mlaReference
Bakar, M.S.A., & Ta's, A. (2012). Data Warehouse Design for Mobile Environment. Knowledge Management International Conference (KMICe), 4(6): 208-212.
Gaspar, V., Madarasz, L., Paralic, J., & Tenaiova, K. (2011). Design and implementation of a client warehouse application over an enterprise resource planning system for mobile devices. Paper presented at the Logistics and Industrial Informatics (LINDI), 2011 3rd IEEE International Symposium.
Golfarelli, M., & Rizzi, S. (2009). Survey Article A Survey on Temporal Data Warehousing. International Journal of Data Warehousing and Mining, 5 (1): 1-17.
Stanoi, I., Agrawal, D., Abbadi, A.E., et al. (1999). Data warehousing alternatives for mobile environments. Mobide '99 Proceedings of the 1st ACM international workshop on Data engineering for wireless and mobile access: 110-115.
Data Warehousing and Mobile Computing
Walmart is the largest company in the world with the estimated one million customers every hour and more than 100 million customers every week. A large number of customer and gigantic supply chain make the company start using the FID system to track moving items and manage the supply chains. However, the FID produces gigantic datasets, which may be challenging to store in the relational database. To address this problem, Walmart develops the data warehousing to store the data, and the company derives cost benefits and data security benefits by transferring the data into the data warehousing. However, Walmart datasets continue to grow, and at present the data has reached 101 terabytes. A change in the business environment makes Walmart make a decision to transfer their data into the cloud. In the present competitive business environment, retail companies are looking for the strategies to cut costs…...
mlaReference
Dabas, C. (2010). A Cloud Computing Architecture Framework for Scalable RFID. Proceeding of the International Multi-Conference of Engineers and Computer Scientists. 1. IMECS.
Foote, P.S. & Malini, K. (2001). Forecasting using data warehousing model: Walmart's experience. The Journal of Business Forecasting Methods & Systems.20(3): 13-17.
Jamal, S.M.K. Omer, A. & Qureshi, A.B.S. (2013). Cloud Computing Solution and Services for RFID-Based Supply Chain Management. Advances in Internet of Things, 3:79-85.
Napper, J. & Bientinesi, P. (2009). Can Cloud Computing reach the top 500? UCHPC -- MAN '09. Proceedings of the Combined Workshops on Unconventional High-Performance Computing Workshops Plus Memory Access Workshop: 17-20.
All of these factors combined to form the catalyst of the data warehouse project being made a higher priority than the many other competing projects within Wal-mart at the time.
At a cost of approximately $3M in software and $9M in services and training, Wal-Mart partnered with Hewlett-Packard and became one of the first companies to adopt the HP Neoview data warehousing system. One of the key reasons for Wal-Mart choosing the HP Neoview data warehousing system was its high level of compatibility with their existing investments in the Teradata databases, which were used as the foundation of their Business Intelligence applications. Wal-Mart also wanted to create a more consistent integration platform to support their etail Link system so that the FID data could be used for calculating the OI of partner investments in the technology.
Lastly, HP Neoview runs on the existing Tandem NonStop operating system and kernel platform to…...
mlaReferences
Mike Duff. "SUPERMARKETS & SUPERCENTERS: CAN THEY REALLY COEXIST? " Retailing Today 26 May 2008: 14. ABI/INFORM Global. ProQuest. 3 Jul. 2008
Paul Sheldon Foote, Malini Krishnamurthi. "Forecasting using data warehousing model: Wal-Mart's experience. " the Journal of Business Forecasting Methods & Systems 20.3 (2001): 13-17. ABI/INFORM Global. ProQuest.. 1 Jul. 2008
Heather Havenstein. "Wal-Mart Turns to HP for Data Warehouse Update. " Computerworld 6 Aug. 2007: 14. ABI/INFORM Global. ProQuest. 3 Jul. 2008
Jianfeng Wang. "ECONOMIES of it SYSTEMS at WAL-MART - an HISTORICAL PERSPECTIVE. " Academy of Information and Management Sciences Journal 9.1 (2006): 45-66. ABI/INFORM Global. ProQuest. 5 Jul. 2008
The data load for CRM systems is less significant than those of Accounting and Financial systems and applications. Those specific fields captured by customers are often compressed into measures of activity as well, and as a result the data load is less significant than in the areas of Accounting and Financial Systems and Reservation and Booking Systems. Even when customized reports are created based on CRM data; the data load is not nearly as significant in Accounting and Financial Systems. The refresh cycles of data in CRM applications however can be quite significant as customer records need to be continually accessed and used for serving customers flying each day and those planning to take flights in the future. As a result, the refresh cycles of customer records, depending on the specific process, are often required to be in real-time. These specific processes include award travel, free upgrades during check-in,…...
Data Warehouse
How Businesses use Data Warehousing
Introduction
Data warehousing is a technological way for businesses to align data with performance benchmarks so that organizations can obtain a long-range view of aggregated data and engage in complex analytics. These analytics typically give the organization a better understanding of what its stockpile of information means, what data trends over time reveal, and what the data indicates is in store for the business in the future. This paper will provide a description of data warehousing, examples of how it is used in a business, challenges that an organization might face when utilizing a data warehouse (i.e., how it can be implemented and what type of training is required to run it), how data warehousing may change in the next five years, and what organizational leaders can do to be prepared.
What is a Data Warehouse?
A data warehouse is a digital storage facility that integrates data from…...
mlaReferences
Bhat, P., & Bose, A. (2018). Application of Information System in Amazon: Issue and Prespectives. International Journal, 6(1), 23-29.Chen, H. M., Schütz, R., Kazman, R., & Matthes, F. (2016). Amazon in the air: Innovating with big data at Lufthansa. In System Sciences (HICSS), 2016 49th Hawaii International Conference on (pp. 5096-5105). IEEE.Debortoli, S., Müller, O., & vom Brocke, J. (2014). Comparing business intelligence and big data skills. Business & Information Systems Engineering, 6(5), 289-300.Gupta, A., Yang, F., Govig, J., Kirsch, A., Chan, K., Lai, K., ... & Bhansali, S. (2016). Mesa: a geo-replicated online data warehouse for Google\\\\'s advertising system. Communications of the ACM, 59(7), 117-125.Rainer, R. & Cegielski, C. (2012). Introduction to Information Systems: Enabling and Transforming Business, 4th Edition. NY: Wiley.
Management
Information management is essential for FedEx. The company uses information in a number of ways. On the operations side, data drives decisions regarding the scheduling of assets. Every piece has its own delivery time guarantee, for example, and it is necessary to use information to ensure that the right piece gets on the right plane and right truck to reach its destination. How this works is as follows.
The customer goes online and schedules a pickup, and the automated system plugs that information directly to the courier who works that route. The package is scanned at pickup. The tracking number of the basis for information on that package -- the person at the destination can see within minutes that the package has been picked up. From there, the package is scanned at the local depot, when it goes on the plane, when it lands at the hub, when it is…...
mlaReferences
Cardon, D. (2016). Database vs. data warehouse. Health Catalyst. Retrieved April 30, 2016 from https://www.healthcatalyst.com/database-vs.-data-warehouse-a-comparative-review
Standen, J. (2012). Data warehouse vs. data mart. Datamartist. Retrieved April 30, 2016 from http://www.datamartist.com/data-warehouse-vs.-data-mart
Database Data Warehousing Design
Data warehousing is a powerful tool that business organizations use to enhance competitive advantages. Data warehousing supports business decision by collecting, organizing and consolidating data for analysis and reporting using tools such as OLAP (online analytical processing ) and data mining. Typically, the relational database technology is generally being used to design a data warehousing and a relational database is a database having collection of tables, and organized based on the relational model. One of the main goals of business organizations is to use data to leverage their strategic competitive advantages. Typically, the data warehousing has become a strategic priority because of the enormous amount of data that organizations need to analyze. Using a relational database, organizations have been able to develop a data warehousing that could assist management to make effective decision. (Microsoft, 2012).
Fundamental objective of this paper is to design the data warehousing for a…...
mlaReferences
Microsoft (2012).Data Warehousing | Microsoft SQL Server 2012. Microsoft Corp.
Tera Data (2012).Enterprise Data Warehouse - Global Leader in Data Warehousing . Tera Data Inc.
Appendices
Appendix 1: ERD for Database Data Warehousing
At times, though, data mining and data warehousing can become more trouble than they are actually worth, and that can lead to all types of problems for a company (Thearling, 2009).
In order to make sure that data mining and warehousing do not become too much trouble for a company to handle, it is vital that the company is clear on the data it wishes to collect. There is no reason to collect every single scrap of data from every person who uses the company's website or searches the internet for the product or service that the company offers. Basic demographic information that relates to the company's product or service, or that relates to the creation of a target market segment, is all very important (Greenfield, 2005a. There are many other data markers that are outliers, however, and that will not have any effect on whether a person would use…...
mlaReferences
Betancourt, L. (2010). How Companies are using your Social Media Data, Retrieved on July 26, 2010 from http://www.enterpriseirregulars.com/5706/the-top-10-trends-for-2010-in-analytics-business-intelligence-and-performance-management/
Greenfield, L. (2005a) The Case for Data Warehousing Retrieved on July 26, 2010 from http://www.dwinfocenter.org/casefor.html
Greenfield, L. (2005b) The Case Against Data Warehousing Retrieved on July 26, 2010 from http://www.dwinfocenter.org/against.html
Hadfield, M. (2009) Case Study: Jaeger uses data mining to reduce losses from crime and waste Retrieved on July 26, 2010 from http://www.computerweekly.com/Articles/2009/02/23/234953/case-study-jaeger-uses-data-mining-to-reduce-losses-from-crime-and.htm
It is important to realize that the level of technology investment at present is sufficient for the current project; this proposal does not necessarily advocate any additional spending on pure technology.
What this analysis pinpoints as a major area of concern is the slow and very gradual transformation of FAC when it needs to move much faster towards its customer goals. The lack of speed and urgency in the shift can be partially attributed to the lack of cohesion and consistency of overall IT strategies to support the next generation of CM business strategies. At present the IT systems and platforms are sufficient yet they will need to change over time to stay current. Figure 1 illustrates how the ETL structure exists today at FAC, highlighting the role of the data warehouse. FAC will need to streamline this architecture if they are going to continually improve.
Figure 1: Topology of an…...
mlaReferences
Bernoff, J., & Li, C. (2008). Harnessing the power of the oh-so-social web. MIT Sloan Management Review, 49(3), 36-42.
Chan, J.O. (2005). Toward a unified view of customer relationship management. Journal of American Academy of Business, Cambridge, 6(1), 32-38.
Cunningham, C., Il-Yeol Song, & Chen, P.P. (2006). Data warehouse design to support customer relationship management analyses. Journal of Database Management, 17(2), 62-84.
Dver, A. (2003). The future of CRM technology. Information Management, 13(7), 22-22.
Sports Line.com, founded in 1994, is the Internet's leading website in Sports media and e-commerce related to sporting goods products. The content of the website includes one million pages of sports related news, information, merchandise, magazine subscriptions and other services. The site also produces the content for major league baseball, the European NFL league and the PGA tour. In addition it provides sports news for many of the major Internet Service Providers including Netzero, America Online, Excite and Netscape. (About Sportsline.com)
Much of the company's success is due to the integration of data warehousing and database marketing into its' e-business solution. The company uses this technology to achieve the following; manage enormous amounts of data, refine their systems to keep up with the rapidly emerging Internet, incorporate data from various sources and analyze incoming data in real time. (Matrix) This allows Sportsline.com to store important data such as customer names, demographics,…...
mlaWorks Cited
About Sportsline.com. http://about.sportsline.com/releases/freefant.htm
Matrix. http://sic.nvgc.vt.edu/SICstuff-Virtual/Heine/WWW/matrix.htm.
Mollison, Caitlin. "A WebSideStory-CBS SportsLine.com." Business Intelligence News. February 19, 2002.
Sportsline.com Has Record Quarter For Page Views." PR News. January 8, 2001. http://www.findarticles.com/cf_0/m4PRN/2001_Jan_8/68856523/p1/article.jhtml?term=sportsline+database+warehousing
Data Warehousing: A Strategic Weapon of an Organization.
Within Chapter One, an introduction to the study will be provided. Initially, the overall aims of the research proposal will be discussed. This will be followed by a presentation of the overall objectives of the study will be delineated. After this, the significance of the research will be discussed, including a justification and rationale for the investigation.
The aims of the study are to further establish the degree to which data warehousing has been used by organizations in achieving greater competitive advantage within the industries and markets in which they operate. In a recent report in the Harvard Business eview (2003), it was suggested that companies faced with the harsh realities of the current economy want to have a better sense of how they are performing. With growing volumes of data available and increased efforts to transform that data into meaningful knowledge that can…...
mlaReferences
Agosta, L. (2003). Ask the Expert. Harvard Business Review, 81(6), 1.
Database: Business Source Premier.
Babcock, Charles (1995). Slice, dice & deliver. Computerworld, 29, 46, 129 -132.
Beitler, S.S., & Lean, R. (1997). Sears' EPIC Transformation: Converting from Mainframe Legacy Systems to Online Analytical Processing (OLAP). Journal of Data Warehousing (2:2), 5-16.
Our semester plans gives you unlimited, unrestricted access to our entire library of resources —writing tools, guides, example essays, tutorials, class notes, and more.
Get Started Now