Scribd
Upload
6 views32 pages

EPM Data Exchange Pipeline Feature 1719213151

The document outlines an Oracle Cloud Customer Connect live event focused on the new Data Exchange - Pipeline feature in EPM, presented by senior software engineers. It details the benefits of using the pipeline for orchestrating EPM cloud jobs, comparisons with traditional batch processing, and various functionalities such as running integrations, business rules, and managing logs. Additionally, it includes a FAQ section addressing common queries about the pipeline's capabilities and scheduling features.

Uploaded by

carajesh.avn
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
6 views32 pages

EPM Data Exchange Pipeline Feature 1719213151

The document outlines an Oracle Cloud Customer Connect live event focused on the new Data Exchange - Pipeline feature in EPM, presented by senior software engineers. It details the benefits of using the pipeline for orchestrating EPM cloud jobs, comparisons with traditional batch processing, and various functionalities such as running integrations, business rules, and managing logs. Additionally, it includes a FAQ section addressing common queries about the pipeline's capabilities and scheduling features.

Uploaded by

carajesh.avn
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 32

Welcome

Thank you for joining this Oracle Cloud


Customer Connect live event.
This webcast will start in a few minutes.

Live Q&A

There will be a live Question and Answer (Q&A) session


following the presentation. If you have any questions, you can
ask them using the Q&A functionality in Zoom. Questions will
be answered in the order received.

The event replay and the slides will be available within one
business day on Oracle Cloud Customer Connect.
Data Exchange - Pipeline
EPM - New Feature

Chandra Bhojan - Senior Principal Software Engineer


Abdul Sherif Mohammed - Senior Principal Software Engineer

EPM
Aug 03, 2023
Safe harbor statement

The following is intended to outline our general product direction.


It is intended for information purposes only, and may not be
incorporated into any contract. It is not a commitment to deliver
any material, code, or functionality, and should not be relied
upon in making purchasing decisions. The development, release,
timing, and pricing of any features or functionality described for
Oracle’s products may change and remains at the sole discretion
of Oracle Corporation.

4 Copyright © 2023, Oracle and/or its affiliates


Data Exchange - Pipeline

• Overview
• Navigations
• Creating Pipeline - Stages & Jobs
• Running Pipeline
• Running Integrations
• Running Business Rules and Rulesets
• Running Batches
• Running Object Store Jobs
• Set Substitution Variables
• Import / Export Metadata
• Running Remote Jobs using Connections
• Logs, Email Notifications and Attachments
• What’s new in August Release?
• FAQ
• Documents
• Q/A

5 Copyright © 2023, Oracle and/or its affiliates


Overview

Benefits of using the pipeline feature

✓ Combine a series of jobs into a single process.

✓ User may also orchestrate EPM cloud jobs across instances from a single place.

✓ Better control and visibility of full extended data integration process of pre-processing, data

loading and post processing jobs.

✓ Supported EPM products - FCCS, EPCM, EPBCS, TRCS.

✓ Combine multiple and different types of jobs as a single process.

✓ Pipeline is better platform than running batches.

6 6 Copyright © 2023, Oracle and/or its affiliates


Pipeline – EPM Process Orchestration

• Orchestrate processing within and


across instances
• Combine processing steps into
logical sequences
• Support for:
• Integration Definitions
• Business Rules
• E-mail notifications
• Copy file to/from Object Store
• Open Batch
• Substitution Variables
• Data Maps planned for CY23H2
• Generic Job Type Planned
• Support for Acct Rec planned soon

7 Copyright © 2023, Oracle and/or its affiliates


Difference between Batches and Pipeline

Batches Pipeline
Run Data Loads only Run Data Load Rules, Business Rules, Custom Rules
and more
Data can be loaded to one Target Application Data can be loaded to multiple target applications
Batches will run in Backend Processes can be monitored in a better User
Interface
Logs can be downloaded only through Process Process logs for each steps can be downloaded from
Details UI directly
Cannot run jobs in the remote instance Jobs can be executed across the instances using
connections
Need to create custom codes for emails Email notification can be triggered without custom
notifications scripts
Logs cannot be sent through the emails Email notifications can contains the logs
ObjectStore commands cannot be run Object Store commands can be run

8 Copyright © 2023, Oracle and/or its affiliates


Data Integration Navigation

9 Copyright © 2023, Oracle and/or its affiliates


Pipeline - Navigation

10 Copyright © 2023, Oracle and/or its affiliates


Creating Pipeline 3
• Defined Run time variables for the jobs
1 • Variables: Predefined and User Defined variables can be defined
• A user variable name preceded by one or two ampersands (&)
Click on + sign to add integration or Pipeline • Validations: List, Text, Look up, File, Custom List

2
• Enter name for the Pipeline
• In Pipeline Code, specify a Pipeline code. Up to 20 characters,
alphanumeric, dashes underscore
• Use the pipeline code to execute the pipeline using a REST API. 4
• Add Stages and Jobs
• Set the Job parameters

11 Copyright © 2023, Oracle and/or its affiliates


Creating Stages & Jobs

New Job

Create Stage

Consolidation Job

Data Load Job

12 Copyright © 2023, Oracle and/or its affiliates


Running Pipeline
1 Run Pipeline from Data Integration screen 3 Job Status

2 Run Pipeline within Pipeline details

13 Copyright © 2023, Oracle and/or its affiliates


Running Integrations
• Many integrations can be added in a same stage or different stages
• The integrations can run in parallel or serial as per the requirement
Jobs can be monitored in the target
• The Sequence of the stages or the jobs can be changed by updating the
application job card
sequence number
• The Job status can be viewed by performing refresh button

14 Copyright © 2023, Oracle and/or its affiliates


Business Rules – Seeded and Custom Rules

• Seeded rules can be executed from the Pipeline at the target application
• Custom rules created in the calculation manager also can be executed
• Run time variables can be set in Pipeline which can override the existing one

Seeded Rules Custom Rules Calculation Manager Rules

15 Copyright © 2023, Oracle and/or its affiliates


Running Business Rules
• Both Seeded and custom rules can be executed
• RTP values can be in advance

Custom Rule

16 Copyright © 2023, Oracle and/or its affiliates


Running Rule Sets
• All the Rulesets from calculation Calculation Manager Rules

manager are listed in the drop down


when selecting Business Ruleset

• User can select the rules and set the


RTP values

17 Copyright © 2023, Oracle and/or its affiliates


Open Batches – By File, Location and Name.
Running Batches
•
• Specify Open Batch directory, File name Delimiter and execution mode. Upload file to Openbatch folder.
• The batches can be run on a remote instance using the connections

18 Copyright © 2023, Oracle and/or its affiliates


Object Store Jobs
The Object Storage requires an Other Web Services Provider connection type. You must ensure you have access to
the Web service you're connecting. You must also have URLs for the Web service and any login details, if required.

19 Copyright © 2023, Oracle and/or its affiliates


Set Substitution Variables
• Variable Name supports up to 255 characters
• Range of values (FY16:FY18)
• Base member range (:) or (::) Ex: 1001::1008
• Parent member Range (:) 1000:3000
• BSO Data Export: Numeric member names within (“ "). Ex: "1100" or "000"
• For Alphanumeric, (“ ") not required. Ex: a1110
• ASO Data Export: (“ ") not required
• For ASO (“ “) not required in the Value field.

20 Copyright © 2023, Oracle and/or its affiliates


Import Metadata
Import Metadata job created in FCCS

21 Copyright © 2023, Oracle and/or its affiliates


Export Metadata Export Metadata job created in FCCS

Metadata export job is listed Pipeline job FCCS Job completion status

22 Copyright © 2023, Oracle and/or its affiliates


Running Remote Jobs using Connections VISION2 Instance

23 Copyright © 2023, Oracle and/or its affiliates


Errors & Logs
Logs files can be downloaded by clicking the icons on the Stage or the Job

24 Copyright © 2023, Oracle and/or its affiliates


Emails & Attachments

25 Copyright © 2023, Oracle and/or its affiliates


What’s new in August Release?

26 Copyright © 2023, Oracle and/or its affiliates


Schedule Pipeline as a Job (CY23Q3)

Schedule and manage like any other Job Type

27 Copyright © 2023, Oracle and/or its affiliates


FAQ

• Is this possible to run EPM Automate commands from Pipeline?


➢ Create Groovy Business rules to call the EPM Automate commands in Calculation Manager.
➢ Run the Business rules from Pipeline
• Is this possible to run Pipeline from EPM Automate commands?
➢ No. Not on the Road map
• Is this possible to schedule a Pipeline?
➢ Pipelines can be scheduled starting from 23.08 release
• Is this possible to run API’s from Pipeline?
➢ API’s can be run using “EPM Platform Job” type starting from 23.08 release

28 Copyright © 2023, Oracle and/or its affiliates


References

Admin Guide – Data Integration Pipeline

https://docs.oracle.com/en/cloud/saas/enterprise-performance-management-
common/diepm/integrations_pipeline.html#GUID-782DFB83-F69C-4654-B7CB-F0A40BFBF2F3

What’s new in August 2023 release?

https://www.oracle.com/webfolder/technetwork/tutorials/tutorial/cloud/epm/wn/epm/releas
es/Aug23/23aug-epm-wn.htm#T51057

29 Copyright © 2023, Oracle and/or its affiliates


Q/A
Thank you

You might also like