Oracle Data Integrator 12c- Getting Started

1 About GluentWe are long term Oracle Database & data Warehousing guys long history of performance & scalingAbout 20 people in distributed teams in US & UKThe world is changing we help customers to get the best out of both worlds!we liberate enterprise data Gluent data Platform enables all applications to access all enterprise data , at anytime, on demand, and without any code migration or rewritesWhy Getting Started 5 Many conference presentations get too technical, too fastWhat is ODI? E-LT (Extract, Load, Transform) vs ETL Heterogeneous sources and targets Built to integrate all data Flexibility Reusable code templates (Knowledge Modules) Open API ODI will adapt to your data warehouse - and not the other way around Flow based mappings 7 What is ODI?

2 8 Where did ODI come from?Early 2000s: Sunopsis formed2006: Oracle acquires : Oracle data Integrator 11g released. Oracle s first real update to 2013: Oracle data Integrator 12c released, combining ODI and OWB : ODI for Big data first released9 ODI 12c Architecture and Components*image source: 12c Architecture and Components*image source: and Configuration Know the different types of installs Standard - used for Standalone Agent or on client machine (ODI Studio only) Enterprise - JEE Agent or Colocated Agent, ODI Console, FMC plugin 11 Choose your installation type wisely12 Configuration is half the battle12 Configuration is half the battleCONFIGURATION ODI_HOME/odi/ |exe Connect to existing repository If none exists, run RCU first Boom, you re in!

3 13 ODI Studio Configuration ODI_HOME/oracle_common/common/ |exe Run the WebLogic Server configuration wizard Standalone Agent Create domain outside of ODI Oracle Home JEE Agent Add credentials mapping Create / configure admin server, nodemanager, topology, or JEE Agent Configuration15 ODI Agent - how it worksODI AgentODI repositorySource databaseTarget database1. Execution request via http(s)2. Agent communicates with ODI repository to generate code and gather source/target connection3. Agent passes code to source/target databases and updates repository execution logsGetting Started data Server Connection to the data source Physical Schema Database schema Work schema Logical Schema Abstracts the physical connection/schema from the logical Development occurs against the Logical Schema Model Metadata object tied to Logical Schema Represents database schema, file directory, XML document, etc Datastore Logical representation of table, file, XML element, , Contexts, Models, and Datastores - Oh my!

4 All of these objects must be created and setup prior to any mapping development can occur. There s another way to get Started - quickly! New Model and Topology Objects wizard - ODI In ODI 11g, the ODI QuickStart was a 10 step checklist, where each step led to another section in the documentation 18 Developer s Quickstart19 Topology, Contexts, Models, and Datastores20 Logical Constraints on the metadata20 Logical Constraints on the metadata20 Logical Constraints on the metadata20 Logical Constraints on the metadataMappings and Knowledge Modules22 Mappings - LogicalDatastore componentJoin componentSplit output to multiple target tablesMappings are built from datastore and components to logically form the ETL23 Mappings - PhysicalPhysical implementations of the mappings are represented based on location of the datastore.

5 Knowledge Modules are selected to generate the - PhysicalPhysical implementations of the mappings are represented based on location of the datastore. Knowledge Modules are selected to generate the will adapt to your data warehouse - and not the other way around24 Knowledge Modules - the secret sauce*image source: Fusion Middleware Developing Knowledge Modules with Oracle data Integrator24 Knowledge Modules - the secret sauce*image source: Fusion Middleware Developing Knowledge Modules with Oracle data Integrator24 Knowledge Modules - the secret sauce*image source: Fusion Middleware Developing Knowledge Modules with Oracle data IntegratorOrchestrationPackages and Load Plans Group like objects together Perform specialized tasks (looping, etc)26 Packages Executes Scenarios (execution objects that are essentially compiled code)

6 Steps can be run in parallel or serially If - then - else step can evaluate a variable to determine path Exception steps can be customized and executed on failure27 Load Plans - the top level orchestration objectMore flexibilityProcedures Reusable components for admin tasks DDL, file archive scripts, exception handling, etc Moving or transforming data , it probably should be a mapping Creating a complex, recurring task for data manipulation, probably a Knowledge Module29 Procedures for maintenance tasks and one-off functionsImages source: Integration with GoldenGate (change data capture) and Enterprise data Quality ( quality) ODI for Big data ODI Cloud Service30 Other notable features Oracle data Integrator an E-LT / data integration tool built to integrate all data flexible.

7 ODI will adapt to your data warehouse - and not the other way around Choose your installation wisely and understand configuration is more involved Many objects must be created prior to Mapping development Use the Developer s Quickstart! Flow based mappings separate business logic from physical implementation Knowledge Modules are the secret sauce of ODI More info: !