Verified Document

Relationships And Distinctions Between The Information Systems Essay

¶ … relationships and distinctions between the information systems concepts of data warehousing and data mining, which combined with online analytical processing (OLAP) form the backbone of decision support capability in the database industry. Decision support applications impose different demands for OLAP database technology than the online transaction processing (OLTP) model that preceded it. Data mining with OLAP differs from OLTP queries in the use of multidimensional data models, different data query and analysis tools at both the user-facing front end and the database back end, and different mechanisms for data extraction and preparation before loading into a data warehouse can take place. The construction of data warehouses entails the operations of data cleaning and data integration, which are key pre-processing steps for enabling data mining. Furthermore, the concept of metadata (data about data) is essential to the functioning of a data warehouse, and must be managed appropriately for an effective and efficient installation (Chaudhuri et. al, 1997). The major commercial players in the data warehousing market today include IBM, Oracle-Sun, Teradata and Microsoft. Data mining functionality is typically included within the data warehousing vendor's software suite. Some vendors have specialized further by creating product suites sold as data warehousing appliances. These consist of an integrated, pre-packaged combination of server and storage hardware, with pre-installed operating system and relational database software that has been optimized for typical medium to large scale customer implementations (Microsoft, 2008).

Gartner (2008) predicted that a fifth of all organizations worldwide would have customized software-as-a- service (SaaS) applications created to supplement their business intelligence operations by 2010. The value-added business of information aggregators is to provide domain-specific analysis capability using competitive business information as a base. This by its nature tends to generate monopolies in vertical information domains, due to the need for aggregators to ensure the confidentiality and secure protection of their clients' sensitive business data. Without proper integration into proprietary internal information stored in data warehouses, customized SaaS-based tools cannot generate the benefits they are expected to provide.

Data warehousing may be defined in its simplest forma as "a process of centralized data management and retrieval" (Palace, 1996). Ideally, a data warehouse is the centralized repository of all of an organization's data, made available for users to access and analyze according to their individual needs through the process of data mining. It provides the tools and mechanisms for business executives to systematically organize, comprehend, and utilize their data to make strategic decisions. In recent years with competition mounting in every industry, data warehousing has become an essential method for organizations to retain customers by learning more about their needs using a solid platform of consolidated historical data and powerful analysis and mining tools (Berson et. al., 1997)

Data mining refers to the ability to enable analysis, categorization and summarization of data from multiple angles or different dimensions. Palace (1996) defines data mining as "the process of finding correlations or patterns among dozens of fields in large relational databases." The relationships, associations, historical patterns and future trends extracted from data in the database are what constitutes useful information or knowledge to the user. Data mining was initially used and promoted by consumer-oriented organizations that needed to deal with large volumes of data related to their business, finances, and customers, so as to be able to effectively design and price their products to address competition and meet customer priorities.

Douq (2009) outlines the set of marketing criteria that most often addressed by vendors of data warehouse products in comparing their own offerings with competing providers. Physical architecture and design, scalability, parallelism, performance and optimization, system availability, ease of operations and management are the subjects most frequently discussed and debated by vendors and analysts in industry circles.

It is useful to distinguish commercial relational databases from the multidimensional database structures used in data mining and warehousing. Traditional relational databases emphasize the operation of normalization (minimizing data redundancy), and are specifically tuned and organized to permit ad-hoc queries upon normalized data stored in tables and indexes. Multidimensional databases organize data in the form of data "cubes," which can be visualized as data sets and subsets implemented in array structures. A data cube consists of a large set of facts or measures, along with a number of associated dimensions. Dimensions are hierarchical entities that the organization wants to record and keep information about (Berson et. al., 1997). For example, a 3-D data cube could display the value of sales dollars, according to the measures of city, product and month sold. A 4-D data cube could add the dimension of year sold to the original three. Figure 1 provides a simplified...

OLAP Cube (Microsoft TechNet, 2011)
Unlike traditional relational database implementations, data may be repeated or reorganized extensively within a multidimensional database to meet the needs for faster search and query operations. Therefore, the needs of data warehouses are most compatible with data mining operations carried out on multidimensional databases (Palace, 1996). Data warehouses commonly utilize three-tier architecture. The first or bottom tier is the data warehouse database server's relational database system. The second or middle tier is an OLAP server implementing the multidimensional OLAP database functionality. The third or top tier is a client layer providing the user-facing query and reporting tools used for mining the data warehouse (Berson et. al., 1997).

Two leading commercial implementations of data warehousing and data mining functionality include Oracle Corporation and NCR Teradata. Both solutions are based upon relational database management systems (RDBMS) at their core. However their origins, implementation specifics, and performance characteristics have significant differences. Oracle's database originally evolved to respond to the market for traditional online transaction processing (OLTP), then gradually evolved to incorporate data warehousing and mining capabilities through its online analytical processing (OLAP) offerings. OLAP functionality is encompassed within the larger Business Intelligence (BI) disciplines, and includes both relational queries and data mining functions to produce output reports oriented to the business functions of finance, marketing, and management. Oracle's OLAP implementation deals effectively with multi-dimensional data by using algorithms optimized to handle rapid drill-down and aggregation in large data sets. This enables the Oracle data warehouse system to respond to complex information queries that may be posed in different ways from different angles (Douq, 2009).

Teradata is generally acknowledged to be the original large scale data warehouse offering. It originated as part of NCR Corporation, and formally separated into its own entity in 2007. The Teradata relational database was created and architected from its earliest beginnings for optimized information retrieval. As such, it is arguably faster and more efficient for certain "pure" data warehousing implementations than Oracle (Douq, 2009).

At a smaller scale, data warehousing and mining capability can also be created using desktop tools such as Oracle MySQL, or Microsoft Access and Microsoft Excel spreadsheets. With the Microsoft product suite, using features such as pivot tables, fact tables and the Query-By-Example function enables search indexing for practical performance on databases of over a million records while bypassing the more sophisticated programming methods involving Structured Query Language (SQL) commonly found in commercial RDBMS products (Microsoft Corporation, 2009)

How effectively a vendor or small business is able to integrate the operations of warehousing and mining of data is a key determinant of not only its competitive strength, but also the type of target implementations where a satisfactory outcome is most likely to result for the end customer. As such, the strategic business intelligence derived from data warehousing and data mining has become a management tool of critical importance to gaining and retaining competitive advantage (King, 2009).

IBM made a strategic entry into the commercial data warehouse appliance space with its acquisition of Netezza as a subsidiary in 2010. Netezza-based appliances feature a proprietary hardware and software implementation called Asymmetric Massively Parallel Processing (AMPP). This architecture incorporates rack-mounted blade format servers and disk storage, with a hardware-based data filtering component using field-programmable gate arrays (FPGA). Following IBM's acquisition of the ten-year-old Netezza technology, it has modified the TwinFins standard configuration to exchange processing modules for additional disk storage within the same two or four-rack assembly, to offer a "near-line" data warehouse appliance (Prickett Morgan, 2010, 2011). Figure 2 illustrates a typical example of a large-scale, commercial data warehouse appliance product, the IBM Netezza.

Figure 2. Typical data warehouse appliance (Prickett Morgan, 2011).

The technical implementation of a data warehouse RDBMS can differ substantially from a standard commercial implementation. For example, data warehouses are designed to optimize the speed of complex data retrieval queries involved in data mining. To accomplish this, a data warehouse RDBMS may store multiple copies of the same data in granular format using a technique called aggregation. De-normalization of data (that is, the use of data repetition and grouping) is common for read-intensive database applications to ensure adequate query response times. Without de-normalization, performance can be seriously hindered by the overhead involved in accessing normalized logical views or join tables across multiple physical data files (Shin et. al., 2006). The technique of indexing for the purpose of increasing query efficiency and…

Sources used in this document:
References

Berson, A., & Smith, S.J. (1997). Data Warehousing, Data Mining, and Olap (1st ed.). McGraw-Hill. Retrieved from http://dl.acm.org/citation.cfm?id=549950

Chaudhuri, S., & Dayal, Umeshwar. (1997). An overview of data warehousing and OLAP technology. ACM Digital Library, 26(1). doi:10.1145/248603.248616

Douq, Q. (2009, November 24). Comparison of Oracle to IBM DB2 UDB and NCR Teradata for Data Warehousing. X-Space. Retrieved November 14, 2011, from http://space.itpub.net/673608/viewspace-620367

Gartner Newsroom. (2008). Gartner Reveals Five Business Intelligence Predictions for 2009 and Beyond. Retrieved November 14, 2011, from http://www.gartner.com/it/page.jsp?id=856714
King, M.A. (2009). A Realistic Data Warehouse Project. Retrieved November 14, 2011, from http://www.eric.ed.gov/ERICWebPortal/search/recordDetails.jsp?searchtype=advanced&pageSize=50&ERICExtSearch_SearchCount=1&ERICExtSearch_SearchValue_0=%22data+warehousing%22&eric_displayStartCount=1&ERICExtSearch_Operator_1=and&ERICExtSearch_SearchType_1=kw&ERICExtSearch_SearchType_0=kw&_pageLabel=RecordDetails&objectId=0900019b803e8a94&accno=EJ868864&_nfls=false
Microsoft Corporation. (2009, January). Data Warehouse in the Enterprise. Retrieved from http://www.google.com/url?sa=t&rct=j&q=data%20warehouse%20in%20the%20enterprise&source=web&cd=4&ved=0CGkQFjAD&url=http%3A%2F%2Fdownload.microsoft.com%2Fdownload%2FF%2F9%2F5%2FF959E048-04DC-40A1-8F17-A0A5BAD23A2D%2FDataWarehouseEnterprise.docx&ei=F3bBTpf1MqeIiAKPkJ2mAw&usg=AFQjCNFKhxz0w7-PEFwchF-Vsz0k8UyCqQ&cad=rja
OLAP Cube. (2011).Microsoft TechNet. Retrieved November 15, 2011, from http://technet.microsoft.com/en-us/library/ee277469(BTS.10).aspx
Palace, B. (1996). Data Mining: What is Data Mining? Retrieved November 14, 2011, from http://www.anderson.ucla.edu/faculty/jason.frand/teacher/technologies/palace/datamining.htm
Prickett Morgan, T. (2010, 24). Netezza to bake analytics into appliances. The Register. Retrieved November 14, 2011, from http://www.theregister.co.uk/2010/02/24/netezza_data_analytics/
Prickett Morgan, T. (2011, June 23). IBM fattens up Netezza data warehouses •. The Register. Retrieved November 14, 2011, from http://www.theregister.co.uk/2011/06/23/ibm_netezza_high_capacity/
Cite this Document:
Copy Bibliography Citation

Related Documents

Geographic Information Systems if the
Words: 1077 Length: 4 Document Type: Term Paper

The introduction of a GIS system that is first defined through the development and implementation of the applications all based on defining and then re-designing the processes by which GIS systems users will be able to do their jobs more efficiently is at the center of the human factors associated with GIS systems. Commonly referred to as change management, human factors are the study of how processes can be

Business Information Systems
Words: 2470 Length: 9 Document Type: Term Paper

Business Information Systems Advantages Internet Electronic Commerce The Internet has much to offer companies like FedEx and UPS. More and more businesses like FedEx and UPS are realizing the long-term advantages and benefits they stand to gain from engaging in electronic commerce. For one companies like these can handle scheduling, shipping and tracking all using the World Wide Web. E-commerce offers businesses several unique advantage, none the least of which is the

System Theory the Origin and
Words: 4711 Length: 17 Document Type: Research Paper

However, in the most recent theory of evolution which discusses the living world appears as the result of chance and an output of different randomly selected natural mills. This kind of development came to present as a result of the need of more subjects or topics in areas such as cybernetic, general system theory, information theory, theories of games which is needed in most decision making process in line

Distinction and Need for Governance at All Three Levels Corporate...
Words: 3850 Length: 13 Document Type: Term Paper

Corporate governance, IT Governance and Information Security Governance IS 8310 Governance, Risk Management and Compliance Governance is the process of empowering leaders to implement rules that are enforceable and amendable. For comprehensive understanding of the term' governance' it is essential to identify the leaders and the set of rules, and various positions that leaders govern. Corporate governance, IT Governance and Information Security Governance embraces a linkage with certain acquiescence system while

Systems Administration V. Network Administration
Words: 1495 Length: 5 Document Type: Essay

The subject matter of systems administration includes computer systems and the ways people use them in an organization. This entails knowledge of operating systems and applications, as well as hardware and software troubleshooting, but also knowledge of the purposes for which people in the organization use the computers. The most important skill for a system administrator is problem solving. The systems administrator is on call when a computer system goes

Relationship Dissolution Ecdriesbaugh Relationship Dissolution
Words: 2992 Length: 10 Document Type: Term Paper

Imbalances were most evident in three relational areas: decision-making, emotional involvement, and equity. A higher percentage of both men and women stated that men usually made more of the decisions, were less emotionally involved, and usually experienced "the better deal." Lastly, male dominance -- but not equality of power between genders -- was found to be linked with greater romantic relationship longevity. It seemed that the higher the relative

Sign Up for Unlimited Study Help

Our semester plans gives you unlimited, unrestricted access to our entire library of resources —writing tools, guides, example essays, tutorials, class notes, and more.

Get Started Now