Enterprise Data Warehouse Optimization with Hadoop on IBM Power Systems Servers

· · ·
· IBM Redbooks
4,3
3 recenzie
E‑kniha
82
Počet strán
Vhodné
Hodnotenia a recenzie nie sú overené  Ďalšie informácie

Táto e‑kniha

Data warehouses were developed for many good reasons, such as providing quick query and reporting for business operations, and business performance. However, over the years, due to the explosion of applications and data volume, many existing data warehouses have become difficult to manage. Extract, Transform, and Load (ETL) processes are taking longer, missing their allocated batch windows. In addition, data types that are required for business analysis have expanded from structured data to unstructured data.

The Apache open source Hadoop platform provides a great alternative for solving these problems.

IBM® has committed to open source since the early years of open Linux. IBM and Hortonworks together are committed to Apache open source software more than any other company.

IBM Power SystemsTM servers are built with open technologies and are designed for mission-critical data applications. Power Systems servers use technology from the OpenPOWER Foundation, an open technology infrastructure that uses the IBM POWER® architecture to help meet the evolving needs of big data applications. The combination of Power Systems with Hortonworks Data Platform (HDP) provides users with a highly efficient platform that provides leadership performance for big data workloads such as Hadoop and Spark.

This IBM RedpaperTM publication provides details about Enterprise Data Warehouse (EDW) optimization with Hadoop on Power Systems. Many people know Power Systems from the IBM AIX® platform, but might not be familiar with IBM PowerLinuxTM, so part of this paper provides a Power Systems overview. A quick introduction to Hadoop is provided for those not familiar with the topic. Details of HDP on Power Reference architecture are included that will help both software architects and infrastructure architects understand the design.

In the optimization chapter, we describe various topics: traditional EDW offload, sizing guidelines, performance tuning, IBM Elastic StorageTM Server (ESS) for data-intensive workload, IBM Big SQL as the common structured query language (SQL) engine for Hadoop platform, and tools that are available on Power Systems that are related to EDW optimization. We also dedicate some pages to the analytics components (IBM Data Science Experience (IBM DSX) and IBM SpectrumTM Conductor for Spark workload) for the Hadoop infrastructure.

Hodnotenia a recenzie

4,3
3 recenzie

Ohodnoťte túto elektronickú knihu

Povedzte nám svoj názor.

Informácie o dostupnosti

Smartfóny a tablety
Nainštalujte si aplikáciu Knihy Google Play pre AndroidiPad/iPhone. Automaticky sa synchronizuje s vaším účtom a umožňuje čítať online aj offline, nech už ste kdekoľvek.
Laptopy a počítače
Audioknihy zakúpené v službe Google Play môžete počúvať prostredníctvom webového prehliadača v počítači.
Čítačky elektronických kníh a ďalšie zariadenia
Ak chcete tento obsah čítať v zariadeniach využívajúcich elektronický atrament, ako sú čítačky e‑kníh Kobo, musíte stiahnuť príslušný súbor a preniesť ho do svojho zariadenia. Pri prenose súborov do podporovaných čítačiek e‑kníh postupujte podľa podrobných pokynov v centre pomoci.