Scribd
Upload
65 views4 pages

Security Log Analytics - Scope Mapping

This document outlines responsibilities for implementing and supporting a SIMS and analytics solution. It assigns primary responsibility for platform setup, data acquisition, ingestion, and security to SIMS, and primary responsibility for data processing, repositories, and enablement to Analytics. Both SIMS and Analytics share responsibilities for some implementation activities, data pipelines, monitoring and alerting, project governance, and ongoing support. The support will be provided for 4 years after initial implementation.

Uploaded by

Sachin Anchal
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
65 views4 pages

Security Log Analytics - Scope Mapping

This document outlines responsibilities for implementing and supporting a SIMS and analytics solution. It assigns primary responsibility for platform setup, data acquisition, ingestion, and security to SIMS, and primary responsibility for data processing, repositories, and enablement to Analytics. Both SIMS and Analytics share responsibilities for some implementation activities, data pipelines, monitoring and alerting, project governance, and ongoing support. The support will be provided for 4 years after initial implementation.

Uploaded by

Sachin Anchal
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

SIMS and Analytics Responsibility Mapping:

# Implementation Activity Responsible

A Data Platform Setup:

1 • Cloudera Big Data platform setup and configuration on Dev, QA and SIMS
Production environments
2 • Network load balancer installation and configuration SIMS

3 • Hadoop ecosystem components installation and configuration SIMS

4 • Edge, Kafka, Nifi nodes installation and configuration SIMS

5 • Installation and configuration of Solr nodes for searching data SIMS

6 • Active Directory integration and kerberization of cluster SIMS

7 • Security implementation- authorization and authentication using SIMS


KMS, KTS and Sentry.
8 • Security and encryption Implementation SIMS

B Data Acquisition & Ingestion:

1 • Implement the push / pull methodology for the agents which would SIMS
be used for log ingestion
2 • Test the device type wise methods to be used for ingestion SIMS

3 • Building data ingestion pipelines for the identified device logs like SIMS
network , security , OS , Application etc
4 Data Processing and Enablement:

5 • Building the Data Repository for the Security log Analytics Analytics

6 • Data processing and storing log data in Big Data Repository layers Analytics

7 • Enabling log data querying, discovery and visualization Analytics

8 • Enabling alerts and notifications Analytics

C Data Layer Design and Creation:

1 • Decide on different Storage layer on HDFS, Hive or Creation of Analytics


HBase/Kudu/Impala as per client's SLA requirement.
2 • Creation of different Layers on different storage areas. Analytics

3 • Populate Sample data in different layers. Analytics

Sensitivity: Internal & Restricted


4 • Check and test for Data integration between various layers. Analytics

5 • Data modelling for building Hive database. Analytics

6 • Design Verification and Sign off should be done by HDFC bank and Analytics
Wipro
D Data Governance and Metadata Management:

1 • Creation of Roles, groups and permissions for different Data Layers. Analytics

2 • Implementing Dynamic Data Masking. Analytics

3 • Implementing Table/HDFS level security. Analytics

4 • Implementing PIIs. Analytics

5 • Setting up the Data Stewards Policy. Analytics

E Streamlining Data Pipelines:

1 • Debugging Yarn/Spark/Scheduler logs for errors Analytics, SIMS

2 • Setting up yarn specific alerts for critical error points. Analytics, SIMS

3 • Assisting Ingestion team in achieving Workload stability. Analytics

4 • Identifying error threshold points with respect to resource Analytics, SIMS


allocation.

F Implementing Monitoring & Alerting:

1 • Setting up the monitoring policy at process, Job, Service level. Analytics, SIMS

2 • Setting up third party monitoring tools as required. SIMS

3 • Custom monitoring if required SIMS

4 • Implementing threshold conditions and setting up alerts for them. Analytics, SIMS

G AI/ML Workbench Setup:

1 • Setup and configure AI/ML workbench in collaboration with OEM SIMS

2 • Do sanitization check with mock models on Analytics to check basic SIMS


interfacing capabilities
3 • Test and certify the AI/ML workbench with test data SIMS

H Project Governance:

Sensitivity: Internal & Restricted


1 • Requirements Analysis and solution definition Analytics, SIMS

2 • Support HDFC Bank during UAT and Go live Analytics, SIMS

3 • Operationalization and stabilization of Cloudera Platform Analytics, SIMS

4 • Training, knowledge transfer and support handover Analytics, SIMS

5 • Project Management, Vendor co-ordination and escalation Analytics


Support with respect to integration of Big Data platform with other vendor
products (Paladion)

Note: Where ever common responsibility mentioned, primarily SIMS will be responsible for activity
related to Platform setup, data acquisition & Ingestion and Security configuration and Analytics will be
responsible for activity related to Data processing, Big data repository and data enablement.

# Support Activity Responsible

1 • Post production support of the platform configured and solution Analytics, SIMS
implemented
2 • Ongoing Configuration/ monitoring and management of Cloudera SIMS
platform
3 • Cluster Monitoring- Monitoring system events, cluster node health SIMS

4 • Cluster monitoring, security checks with respect to authorization SIMS


and authentication
5 • Role based User, group creation, granting the required privileges. Analytics, SIMS

6 • Job tracking, troubleshooting common cluster issues and SIMS


performance bottlenecks.
7 • Managing and supporting the Hadoop jobs incidents such as Analytics, SIMS
failures
8 • Stabilizing cluster, troubleshooting any platform or integration Analytics, SIMS
issues
9 • Performance tuning of Hadoop Cluster SIMS

10 • Capacity monitoring and allocation on ongoing basis SIMS

11 • Troubleshooting issues related to data ingestion and processing Analytics, SIMS


pipelines on Big Data Platform
12 • Troubleshooting and fixing integration issues Analytics

13 • Backup and recovery process of Hadoop storage SIMS

Sensitivity: Internal & Restricted


14 • Documentation (Support manual) and handover. Analytics, SIMS

15 • Annual support for a period of 4 years from year 2 to year 5 Analytics, SIMS

16 • Stabilizing cluster, troubleshooting technical issues SIMS

Sensitivity: Internal & Restricted

You might also like