0% found this document useful (0 votes)
151 views6 pages

2

This document contains various URLs, file paths, commands and snippets of code related to Ab Initio environments, projects and data. It includes links to control center interfaces, JIRA issues, Bitbucket repositories, Jenkins jobs and internal file paths for sandbox data and mapping projects. Commands shown include using Air to view object versions and tags, checking file permissions and copying files between HDFS locations.

Uploaded by

Ayush nema
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
151 views6 pages

2

This document contains various URLs, file paths, commands and snippets of code related to Ab Initio environments, projects and data. It includes links to control center interfaces, JIRA issues, Bitbucket repositories, Jenkins jobs and internal file paths for sandbox data and mapping projects. Commands shown include using Air to view object versions and tags, checking file permissions and copying files between HDFS locations.

Uploaded by

Ayush nema
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
You are on page 1/ 6

http://mimi16.dev.df.sbrf.ru:7234/expressit-4-0-2-1/app/app.html?

appIdentifier=da24#/view/manager
http://mimi16.dev.df.sbrf.ru:7234/expressit-4-0-2-1/app/app.html?appIdentifier=ta24

https://mimi16.dev.df.sbrf.ru:8227/controlcenter/spa/index.jsp#/schedule/
system=da24_USL/monitorMode=grid

beeline -u 'jdbc:hive2://tkli-od0010.dev.df.sbrf.ru:10000/default;principal=hive/
[email protected]'

https://jira.ca.sbrf.ru/browse/BICHD-6199
Environment--Issue in CTL trigger mechanism
tkli-od00000151.st.df.sbrf.ru
https://stash.delta.sbrf.ru/projects/USLTF--Release 2 to create automatically index
files
/data/mfs/mfs_hdfs_4way
beeline -u
'jdbc:hive2://tkli-od00000148.st.df.sbrf.ru:10000/default;principal=hive/tkli-
[email protected]'; ----- esse connect karo ST pe

http://tklis-fauna0230.st.df.sbrf.ru:8080/cc/spa/index.jsp#/job/guid=a351feb-
6188c1d6-2010-184/tab=view?mode=details ---ST CC link
http://mimi16.dev.df.sbrf.ru:7770/trw/app/index.jsp#/repo/%2F
%2Fmimi16.dev.df.sbrf.ru%2Fabinitio%2Feme%2Fdev_datacloud/branch/main/explorer --
eme path

/data/envs/data/ta24/data/serial/sberbank/mapping/asfs/lookup/asfs/delta--lookup
path

AB_HIVE_JDBC_URL
:jdbc:hive2://tkli-od0010.dev.df.sbrf.ru:10000/default;principal=hive/tkli-
[email protected]

AB_HIVE_JDBC_URL
:jdbc:hive2://tkli-od0010.dev.df.sbrf.ru:10000/default;principal=hive/tkli-
[email protected]

http://mimi16.dev.df.sbrf.ru:7234/expressit-4-0-2-1/app/app.html?appIdentifier=da24

http://mimi16.dev.df.sbrf.ru:7234/expressit-4-0-2-1/app/app.html?appIdentifier=ta24

http://ctl-dev.dev.df.sbrf.ru:8080/ui/index.html#monitoring�--latest ctl link


http://ctl-dev.dev.df.sbrf.ru:8080/ui/index.html#wf --ctl link

https://sbt-jenkins.ca.sbrf.ru/datafactory/job/DataFactory/job/Ab_Initio/job/
Environments/job/Create_tag_1.0.0/---jenkins link

https://sbt-jenkins.ca.sbrf.ru/datafactory/job/DataFactory/job/Ab_Initio/job/
Environments/job/Deploy_1.0.0/4967/console ---to check logs

https://sbt-jenkins.ca.sbrf.ru/datafactory/job/DataFactory/job/Ab_Initio/job/
Environments/job/Deploy_1.0.0/

https://jira.ca.sbrf.ru/browse/DOTOOLS-25349

https://sbrf-bitbucket.ca.sbrf.ru/projects/DATAFACTORY_DATACLOUD/repos/
ci00757159_abinitio/browse/Ansible/inventories/dev/abinitio/host_vars/ta24/
sandbox_parameters.yml?at=refs%2Fheads%2Ffeature%2FBICHD-2755--bit bucket
air -branch team_wm tag object-versions USL.R009.21.IDL_PUB.1.1.4.54766.USL-
542.team_rd.20210818171528
[email protected]
/home/out-lakshmi-l/da24/private_sand/sberbank/mapping/configurator
da15--permission denied
/data/envs/sandboxes/da15
/data/envs/sandboxes/ta24
u_abi_s_usl_ta24
/abinitio/ab_work_dir
usl_ndl_asfs_subj_ind.test.day0.1.conf-1.txt
USL.R009.7.mdw_generated.1.0.0.48892.USL-369.team_wm.20210712165502---da24

USL.R009.7.mdw_generated.1.0.0.53025.USL-369.team_wm.20210809122040
Zx127539
/abinitio/run
USL.R009.28.MDW_PUB.1.0.0.56387.USL-615.B0026.20210901120246

USL.R009.7.mdw_generated.1.0.0.48892.USL-369.team_wm.20210712165502

AB_AIR_ROOT : /abinitio/eme/dev_datacloud
AB_AIR_BRANCH : B0024
AB_USERNAME @datanodes :out-lakshmi-l
AB_HDFS_PRINCIPAL :
AB_HDFS_KEYTAB :
#AB_HIVE_JDBC_URL
:jdbc:hive2://tkli-od0008.dev.df.sbrf.ru:10000/default;principal=hive/tkli-
[email protected]
AB_SSH_NEEDS_PASSWORD : false // We will be using kerberos tickets, so no need
for password
AB_SSH_NEEDS_PASSWORD @ datanodes : false // We will use kerberos ticket to
connect to datanodes so no need for password
AB_HDFS_MUX_USE_TICKET : true // We will use either the default kerberos ticket
or the specific kerberos ticket for data access on edge node
AB_HDFS_MUX_USE_TICKET @ datanodes : true // force multiplexers to use tickets
AB_CONNECTION_EXTRA_ARGS : -K
MDW_SERVICE_PORT_LEAST

/home/out-lakshmi-l/da15/sberbank/interfaces/REP_SRC_PUB

hdfs dfs -cp


hdfs:///data/usl/ndl/asfs/7090/ndl_asfs_gl/day0/acc_entries/active=1/
instance_code=none/*
hdfs://nameservice/data/core/internal/da24/asfs_szb/pa/CCYOP/acc_entries

hdfs:/data/usl/da24/ndl/asfs/delta
/home/out-lakshmi-l/da24/sandboxes/sberbank/mapping/idl/idl/mp
hdfs:/data/usl/ndl/asfs/delta

$AI_PSET/mdw_keys_services.start.pset -KEY_SEQUENCE_WHITELIST 708108099

air -branch team_wm project show-common Projects/sberbank/mapping/mdw_generated

$KEY_REF_DIRECTORY/$BATCH_CODE/key_ref_${KEY_ID}.idx

DEPLOY_UTILS_PUB

$[string_concat(AI_CONTROLCENTER,"/","USL")]
/data/envs/data/da24/data/mfs/mfs_dnlocal_4way/mdw_generated/main/asfs/szb
m_chmod 777 -R /data/envs/data/da24/data/mfs/mfs_dnlocal_4way/mdw_generated/main/
asfs/szb

air -branch main versions


/Projects/sberbank/mapping/DEPLOY_UTILS_PUB/mp/deploy_hive.mp

air -branch team_wm versions


/Projects/sberbank/mapping/DEPLOY_UTILS_PUB/mp/deploy_hive.mp

air -branch team_wm versions /Projects/sberbank/mapping/idl/idl

air -branch team_wm versions /Projects/sberbank/mapping/mdw_generated


air -branch main object cat
/Projects/sberbank/mapping/MDW_PUB/state/key_sequence_list.cfg
air -branch main object cat
/Projects/sberbank/mapping/MDW_PUB/state/key_sequence_list.cfg |grep 708108099
co op version 4.0.2.1

$AI_PSET/mdw_keys_services.start.pset -KEY_SEQUENCE_WHITELIST
763488899,1988569258,1357162218

air -branch main versions /Projects/sberbank/mapping/MDW_PUB

air -branch team_wm tag ls

air -branch main object cat


/Projects/sberbank/mapping/asfs/bin/deploy/usl_ndl_asfs_subj_ind.prod.day1.1.conf.t
xt

air -branch team_wm object cat


/Projects/sberbank/interfaces/ESS_PUB/bin/run_cc_job_list_instance.ksh

6.1)click on """info icon""" next to system name. select option "edit".


select ""properties"" tab . click on "+" symbol and choose "input from job".
fill Name as ""READ_TEMP_INSTANCE_FILE_FLG"". add description as Flag to read
instance from AI_SERIAL_LOOKUP path set type as "string" set default value
as 16.2)click on """info icon""" next to system name. select option "edit".
select ""properties"" tab . click on "+" symbol and choose "input from job".
fill Name as ""TEMP_INSTANCE_FILE"". add description as "instance file path on
$AI_SERIAL_LOOKUP (asfs)" set type as "string"

air -branch team_wm object cat /Projects/sberbank/mapping/mdw_generated

air -branch usl_model object cat


/Projects/sberbank/mapping/mdw_generated/xfr/loads/ab_ess_logical_subj_h/
rollup_normalize_start_end_binary.xfr

air object changed


/Projects/sberbank/mapping/mdw_generated/xfr/loads/ab_ess_logical_subj_h/
set_existing_metadata.xfr -branch1 usl_model -branch2 main -diff
USL.R009.28.mdw_generated.1.0.0.57009.USL-615.B0026.20210906112340

- /sberbank/mapping/mdw_generated

sudo -i -u u_abi_s_usl_da24 m_rollback -d


/abinitio/run/mdw_keys_service_708108099.rec

/data/envs/data/da11/data/serial/sberbank/mapping/asfs/lookup/asfs/delta/
snap_hist_ctl_loading_acc_operations_szb.lkp

/data/envs/data/da11/data/serial/sberbank/mapping/asfs/lookup/asfs/delta/
snap_hist_ctl_loading_acc_operations_bkb.lkp

USL.R009.28.mdw_generated.1.0.0.56680.USL-615.B0026.20210902124850

air -branch main object rollback


/Projects/sberbank/mapping/unsi/bin/deploy/r8.ndl_rdm.day1.job.list -to-version
28361

air object changed


/Projects/sberbank/mapping/mdw_generated/xfr/loads/ab_ess_logical_subj_h/
add_updates_partition_keys.xfr -branch1 team_wm -version1 54532 -branch2 main -
version2 56740 -diff

$AI_SERIAL_LOOKUP
/data/envs/data/da24/data/serial/sberbank/mapping/asfs/lookup/asfs

ndl_ddl_agr_snp

/data/core/internal/da11/R1

hdfs://nameservice/data/core/internal/ta11/asfs_bkb/pa/CCYOP/hist/
acc_operations_hst_0_20200121000000

java -jar ctl-client.jar all http://ctl-dev.dev.df.sbrf.ru:8080/v1/api


ctl_wait4replica_usl_idl_rdm_subj.yaml

ta24_ed946198-1dec-4e34-aa42-bfe8f96c03e5
ta24_1d28e5e0-3de8-4907-89d5-270e50c60feb

air tag combine -create mdw_generated.G.USL-85.20210426104301.USL-1181.USL-


85.20210420091658 -latest mdw_generated.G.USL-85.20210420082618.USL-1181.USL-
85.20210420091658 mdw_generated.O.USL-49.20210426094106.USL-9439

usl_model.R009.33.model.7.32.1.USL-12798.20211016035606
m_rm -f /abinitio/data-mount/data/mfs/mfs_dnlocal_10way/ACQUIRED_DATASET_PUB/main/
idl/ab_ess_logical/ndl_eks_agr__prod_cred/
ab_ess_logical_prod_cred.202109291817.pre_load.dat

cd /data/envs/data/da15/data/mfs/mfs_dnlocal_4way/ACQUIRED_DATASET_PUB/main/idl/
ab_ess_logical/ndl_ddl_agr__agr_cond

/data/envs/data/da15/data/mfs/mfs_dnlocal_4way/ACQUIRED_DATASET_PUB/main/idl/
ab_ess_logical/ndl_ddl_agr__agr_cond
sberbank/mapping/idl/idl/pset/o_usl_idl_agr_cred_c.pset

/abinitio/data-mount/data/mfs/mfs_dnlocal_10way/ACQUIRED_DATASET_PUB/main/idl/
ab_ess_logical/ndl_ekp_gl__syntacct/ab_ess_logical_syntacct.20210813.dat

/sandboxes/sberbank/mapping/eks/pset/o_ess_replica_to

/abinitio/data-mount/data/admin/sberbank/mapping/eks/tracking/eks/
o_ess_eks_z_sm_symks_dlta_2021-11-17-16-43-49_19126.tracking

/abinitio/data-mount/data/admin/sberbank/mapping/eks/tracking/eks/
o_ess_eks_z_mn_dcm_dlta_v2_2021-11-17-16-41-55_27582.tracking

hdfs dfs -cp /data/core/internal/da11/R01/eks/day0/z_client/*


hdfs://nameservice/data/core/internal/da15/EKS/pa/IBS/z_client

hdfs dfs -ls hdfs://nameservice/data/core/internal/EKS/pa/IBS/z_main_docum

o_ess_eks_z_mn_dcm_dlta_v2.pset

ess_pre_eks_paydoc_cash_symb.mp

$FILTER_CONDITION

/Projects/sberbank/mapping/mdw_services

ndl_rdm--crncy--225--day0
ndl_ekp--crncy-20--day0

505038
hdfs:///data/usl/ndl_uvdo/etalon_new/snp/day1/crncy
drop table if exists ${MDW_AB_ESS_LOGICAL_TARGET_SCHEMA_NAME}.crncy;
create external table usl_ta15_ndl_rdm_snp.crncy (
ctl_validfrom timestamp,
crncy_dp_code string,
dirty_flag boolean,
name string,
crncy_sk bigint,
iso_code string,
digital_code string,
sid string,
ctl_loading bigint)
partitioned by (active string,instance_code string)
stored as parquet
location 'hdfs://nameservice/data/usl/ta15/ndl_rdm/snp/crncy';

msck repair table ${MDW_AB_ESS_LOGICAL_TARGET_SCHEMA_NAME}.crncy;

You might also like