Data Monitoring: To Design & Optimize Data Warehouse

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 4

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 4, July August 2013 ISSN 2278-6856

Data Monitoring: To Design & Optimize Data Warehouse


Nirmal Sharma1, S. K. Gupta2
1

Research Scholar Computer Science, Teerthanker Mahaveer University Muradabad, U.P., INDIA
2

Computer Science. & Engineering. Department of BIET, Jhansi, U.P., INDIA

Abstract: In this research paper will discuss the data


monitor, design, & optimize the Information Technology Companies. Data warehouse has unlimited storage, it can be monitor very difficult and time spending problem. It presents successful steps in data warehouse. The main objective of this paper is the problem should be clear & specified, and have monitor of tool criteria for usage. If specify these problems and get business and monitor the organization. This paper approach is specified on their data warehouse and data design. The data warehouse is optimizing by cost prioritize & invest business i.e. many ways for development. In this condition monitors the data through optimization [1]. This

paper can change in data warehouse and take decision to optimize business resource. With exploding data tools
and increasing analytic complexity, Information Technology managers are draft & respond to business resource needs while reducing the costs associated with data warehouse. Unfortunately, administrative managers, application programmers, data architects and system analysis do not have the required equipments to get visibility and understand what data is used, unused and more useful, how data is being used to retain and optimize of monitoring tool. However, to increase operational efficiency reduce data Warehouse costs & monitor tool. It requires the collaboration of different business groups. Legacy monitoring tools are designed for system administrators & system analysis. This paper does not provide the necessary equipments for data integration professionals.

Keywords: Data warehouse, Data Information Technology & Monitoring.

optimization,

path of supporting this growth without a prohibitive impact on resource and infrastructure costs. Just as business units rely on data to make informed decisions that drive the profitability and cost controls. IT organizations have to assess how the business is utilizing the application and data assets to make informed decisions [3]. In this paper, to increase operational efficiency and reduce the cost of investing data resource requires the collaboration of different groups & information technology. Every group needs to be in lock way with the evolution of the Business Intelligence and Data Warehouse deployment to ensure optimal performance and to control support business cost. A process is implementing, analyzing and taking clear activity on bases of delivering data immediate and quantifiable profits. Business Intelligence and Data Warehousing provide visibility, business activity and data usage to manage the data integration processes and accurate efficiently. Business invests resource to help justify costs, and prioritize tool based on data utilization. The software provides detailed insight into data usage, data dormancy and workload metrics by non- disruptively capturing and correlating business user activity, application data, reports [4]. Application manager is respond faster to end-user complaints. It improves business intelligence application performance. That specified problem meets audit requirements for security or regulatory requirements.

1. INTRODUCTION
In this approach, as data usage to deliver increased operational efficiency, ensure scalability of both infrastructure and available Information Technology resources and reduce data warehouse costs [2]. The main objectives of Business Usage monitoring are to: Justify costs, prioritize and invest resources based on business utilization. Retain and optimize the most relevant data and processes. Respond faster and ensure scalability and performance. Data Warehouses in large enterprises are now routinely growing into the tens and hundreds of terabytes and data management costs and complexity are growing exponentially. Organizations cannot continue down the Volume 2, Issue 4 July August 2013

2. PROBLEM
How to increase operational efficiency reduce data warehouse cost using monitoring tool?

3. METHODOLOGY
A review of literature indicates that, business usage of analytic applications & appetite for large data. An Analytic data is getting bigger by the minute as the amount of raw data and number of source systems continues to burgeon. Data warehouse is stored now growing into tens and hundreds of Terabytes very rapidly. A recent study conducted by Aberdeen Group showed that large enterprises witnessed as 41% growth in data year over year from 2009 to 2010 (Source: Data Management for Business Intelligence Aberdeen Group, December 2010). While the data growth is exploding, the Page 262

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)


Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 4, July August 2013 ISSN 2278-6856
same study also found that 50% of the organization expressed that a lot of data is not accessed or underutilized by business [6]. 3.1 Table 1: Existing research & Current research resources analysis[5] Very often, Garment organization operates on intuition to make key decisions relating to hardware and software investments as well as performance optimization. By measuring and analyzing usage activity from a businessutilization, Garment organization not only can develop key performance objectives and metrics, but can measure the results. It also measures the effectiveness of their investment, drive initiatives that can gain the most business value, and reduce the total cost of ownership [7]. 3.3.2 Table 2: Existing research & Current research Costs, Prioritize and Invest resources analysis

3.2 3-D Cone Chart 1 Existing research & Current research resources cost based analysis In this table1 & Chart1 show the existing & current research resources & costs analysis and how to get the benefit of business organization time to time implement the growth of per year faster space and increase cost by this Legacy database monitoring tools [5]. 3.3. Result Analysis The objectives of business usage monitoring should be to: 3.3.1. Justify Costs, Prioritize and Invest resources based on Business Utilization. Data warehousing is upcoming vision complex organizations, to deliver sustained value to the business with spreading Information technology costs. By facing & growing data and upgrading business demands of faster and important information, how the business is utilizing existing investments to help justify costs prioritize resources and make informed investments. By tracking, priority order based business utilization and data emerging trends, organizations can assess and identify underutilized Information technology tools along with highly utilized but under performing tools to reduce costs and change of business utilization for future resources.

3.3.3 3-D Cone Chart 2 Existing research & Current research Costs, Prioritize and Invest resources analysis 3.3.4. Retain and optimize the most relevant data and processes. Information technology teams need to understand how users interact with data to ensure the most important business information is optimized and made readily available. Organizations should assess what data is being used and what data is not being used but unnecessarily loaded and maintained. How data is being used, Information technology teams can be better aligned with the business while reducing the costs of storage and data warehouse. 3.3.5 Respond faster and ensure scalability and performance. [8]Data warehouse systems are increasing in data size and complexity, and must be regularly available to support diverse, international & national user Page 263

Volume 2, Issue 4 July August 2013

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)


Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 4, July August 2013 ISSN 2278-6856
communities. Business users expect that Information technology teams proactively discover and respond to issues before critical business services. 3.3.6 Table 3: Existing research & Current research faster space & ensure scalability performance. The legacy application monitoring tools are not designed to provide visibility into how the business uses analytical data. The legacy database monitoring tools do not integrate with analytical applications. Therefore, it cannot and do not provide insight into how the business users and applications interact with analytic data. The legacy database monitoring tools are due to their heritage of being designed for transactional database systems and for the use of system. DBAs, do not provide adequate analysis of data usage (at an object level) in any meaningful way that can be consumed by data architects, application managers, data warehouse developers and data management executives [9]. For example, a big manufacturing organization that supports over 30,000 crystal reports used by over 20,000 global users, analyzes how analytical applications and reports interact with data during the test and development stages to optimize end-user experience and performance. They monitor usage on production systems to compare data usage and associated performance properties against benchmarks developed in test and development to rapidly discover areas of optimization. The manufacturing organization estimates savings of over $3 million in costs by improving aggregated processing times by over 33,000 hours which directly impacts business user experience and productivity as well as ensuring scalability of existing investments in infrastructure[10].

4. Conclusion
3.2.2 3-D Cone Chart 3: Existing research & Current research faster space and ensure scalability and performance. Identifies who, what, and why of data usage for retain and optimize the most important data. Provide end-to-end visibility into business-Data warehouse stack to optimize query performance [11]. In this research paper, data Warehouses in large enterprises are regularly growing into the hundreds and thousands of space and the associated data management costs, prioritize and complexity growth exponentially. Business Usage Monitoring enterprises show visibility into business activity and data usage to deliver increased operational efficiency, ensure scalability of both infrastructure and available Information technology resources and reduce data warehouse costs. It shows integrity profits a specific solution for usage monitoring. It should be combined with best practices to analyze and to take meaningful action. Additional effectives are monitoring require a solution that integrates with the business data warehouse and data integration stacks to provide a complete view into business advantages and data monitor [12]. A process is implementing to analyze and take action on the bases of analysis. That can deliver data to immediate and quantifiable benefits. It presents a conceptual model for data warehouses. The database is pre-existing Entity/Relationship schemes describing a database. The data source that would enable the developer of the data warehouse to know what content exists with the data warehouse. The number of users, query volume and query complexity changes with alarming irregularity as data warehouses grow in size and complexity.

3.2.3 Flow Chart 1: Data warehouse team model & visibility into Business user

Volume 2, Issue 4 July August 2013

Page 264

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)


Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 4, July August 2013 ISSN 2278-6856 References
[1] Andrews Consulting Group, Why You Need a Data Warehouse Inc. 2011 [2] Kimball et al., The Data Warehouse Lifecycle Toolkit, ISBN 978-0-470-14977-5, 116117, Third Edition. New York, Wiley, 2008. [3] Appufluent Analytics for IT www.appufluent.com [4] Imhoff, Galemmo, Geiger, Mastering Data Warehouse Design, Wiley Publishing Inc., 2003. [5] Han J., M. Kamber, Author, Title:Data Mining: Concepts and Techniques, Academic Press, 2001. [6] Data Quality Tools for Data Warehousing - A Small Sample Survey, center for technology in government 1998. [7] Carbone, P. L., Author, Title:Data Warehousing: Many of the Common Failures. Mitre.org, May 3, 1999. [8] Sweiger, M., Author, Title: Click stream Warehousing. New York: John Wiley &Sons, 2002. [9] Roberto Battiti and Mauro Brunato, Author, Reactive Business Intelligence: From Data to Models to Insight, ISBN 978-88-905795-09,Reactive Search Srl, Italy, February 2010 [10] Karl Rexer, Paul Gearan, & Heather Allen, Author, Title:2008 Data Miner Survey Summary, presented at SPSS Directions Conference, Oct. 2008, and Oracle BIWA Summit, Nov. 2008. [11] Duane Nickull (2003). "Modeling Method to Harmonize Disparate Data Models" [12] Gartner, Gartner Identifies the Top 10 Strategic Technologies for 2009, October 2008 Examiner in different Institutes/Universities time to time i.e. CCSU Meerut/UPTU, Lucknow.

Research Guide
Second Author -Dr. S. K. Gupta (Profile) Presently working as A.P. in Comp. Sc. & Engg. Deptt. of BIET, Jhansi, U.P., INDIA. Currently on deputation by State Govt. at Mahamaya Technical University (MTU), Noida, U.P., INDIA as Joint Controller Of Examination. Initially graduating in Computer Science & Engineering from H.B.T.I., Kanpur, U.P., INDIA and then M.E. from M.N.R.E.C., Allahabad, U.P., INDIA and after that completed Ph.D. in Computer Science & Engineering from Bundelkhand University, Jhansi, U.P., INDIA. 05 Ph.D.s are going on. 04 M.Tech. thesis and 40 B.Tech. /M.C.A. projects supervised. Published 06 Paper in International Journals, 01 in International Conference, 06 in National Conferences, attended 01 International Conference, 01 Winter School, 06 STTP, 09 International/National Workshops/Conferences. Other responsibilities i.e. Head, Deptt. Of I.T. at BIET, Jhansi, Head Examiner, for different subjects of C.S. and I.T. in Central Evaluation of U.P.T.U., Lucknow, U.P. Member of Inspection Committees, constituted by UPTU, Lucknow for approval of New Institutions/Courses/Extension of Approval/Seats time to time. Member of Board of Studies/Paper Setter/Practical Examiner in different Institutes/Universities time to time i.e. UPTU, Lucknow, RGPV, Bhopal, M.P., Jivaji University, Gwalior, M.P., MGCGV, Chitrakoot, M.P., B.U., Jhansi, Jaypee Institute, Guna, M.P., MITS, Gwalior, M.P. etc. Approved Counsellor/Project Evaluator of I.G.N.O.U. for M.C.A. and B.C.A. courses.

Research Scholar
First Author - Nirmal Sharma (profile) Pursuing PhD from Teerthanker Mahaveer University Muradabad, U.P., INDIA. Currently on working Aryan Institute of Technology Ghaziabad, U.P. INDIA as A.P cum Head of the department of computer science & Engineering. Initially Graduating from CCS university Meerut U.P. INDIA and then Master in Computer science from Rajasthan Vediyapeeth Rajasthan. And then M.Tech I.T. From Vinayak Mission University, Tamilnadu. And MCA from IGNOU. New Delhi. Published 04 Paper in International Journals, 02 in National Conferences, attended 01 International Conference 02 National Workshops/Conferences. Other responsibilities i.e. Head, Dept. Of CSE & Time Table Convener at AIT, Ghaziabad, INDIA Head Examiner, for different subjects of C.S. and I.T. in Central Evaluation of M.T.U.NOIDA /U.P.T.U., Lucknow, U.P. Paper Setter/Practical Volume 2, Issue 4 July August 2013 Page 265

You might also like