AGS Security Patch Process
AGS Security Patch Process
This session shows how to set up a monthly patch process based on the application System
Recommendations within the SAP Solution Manager to track down critical Security Notes which are
required for your systems.
See the integration with the Usage Procedure Logging (UPL) and the Business Process Change Analyzer
(BPCA) to identify business processes which might get affected by the implementation of security notes.
And you will get additional information about the cross-system queries of Configuration Validation which
can be used to analyze the security configuration for single systems as well as for the complete system
landscape.
Goals:
➢ Identify required security notes for a large system landscape.
➢ Manage work lists with notes that should be implemented.
➢ Audit successful implementation of required security notes.
“ Isn’t SAP using advanced techniques to avoid security flaws? Just like Microsoft, Google or Apple do?
1. SAP operates research departments for code security which are top league.1
2. In its code development lifecycle, SAP makes use of a variety of mechanisms to keep a very high level of quality. This
includes dynamic code scanning, static code scanning, automated dynamic testing (such as fuzzying) and other
techniques – wherever these are suitable.2
3. Unfortunately, hackers and security researchers find new attack methods over time. This makes fixing newly
discovered vulnerabilities inevitable. And Oracle, Microsoft, Google and Apple are no exception to this rule.
4. SAP makes sure that only critical patches or those with dependencies to other software releases are published.
1. Customer SAP system was deeply compromised, including full administrative access & code changes
2. Attackers got in through “Hot News” (very high) vulnerability that was not patched for months
3. What next? Options were very limited:
Security Notes
■ are standard SAP Notes / HotNews
■ with information about known security vulnerabilities
■ and appropriate countermeasures (correction instruction, configuration, service
pack, upgrade, manual measures)
■ whose corrections are contained in subsequently released Support Packages, if
possible
4381 Document(s)
Average
of ‘typical’
month
?
?
How to identify important
SAP Security Notes
that need to be implemented?
Java patches
A patch is a code-correction for a specific version of an SAP product.
SAP System
Legal Change notes
Respond to requirements caused by changes in legal regulation
You have to apply various
types of notes and patches to HotNews
keep your SAP systems up-to- SAP customer notes with priority 1 (very high priority) to resolve or avoid
date and secure. problems that can cause the SAP system to shut down or lose data.
or (recommended)
New released Legal Change notes
▪ You can use application System SAP notes
Recommendations in the SAP
Solution Manager to check all
relevant notes and patches for HotNews
the selected systems and easily
keep all of your systems up-to- System measurement
date. System and correction notes
Recommendations
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 43
System Recommendations
Advantages & Features
◼ Increase system security by ◼ The recommendations ◼ Integration into Change
applying up-to-date security- comprise the following notes Request Management
relevant notes exactly tailored categories: (CharM) to directly create
for the respective system
➢ Security notes Requests for Change for the
◼ Provides a detailed selected notes
➢ HotNews
recommendation based on ◼ Integration with Usage
➢ Performance relevant notes
the system release and Procedure Logging (UPL) to
already implemented SAP ➢ Legal Change notes
distinguish between used and
notes ➢ System Measurement notes
unused code
◼ Easy-to-use filter settings ➢ Correction notes
(deactivated by default) ◼ Integration into Business
allow exact selection of Process Change Analyzer
system or solution (BPCA) to calculate the test
impact
Customer SAP
1. Select system to check
& update Connect to SAP Global
3. Support Backbone
2. Retrieve system
information (SP level, 5. Send information back to 4. Provide information on latest
patch level) the customer‘s SAP relevant notes (for SP level,
Solution Manager patch level)
system
On the Solution Manager, start the Fiori Launchpad and navigate to the Fiori Tile Group
“SAP Engagement and Service Delivery”
How?
Start transaction “SOLMAN_WORKCENTER”
and then navigate to “SAP Engagement and ...”
or
Start the Work Center from the Easy Access menu tree
or
Add a link for the Fiori Launchpad on your Favorites.
3
Add a link on your Favorites.
2
How?
In the Advanced search you can reduce the list of SAP notes.
▪ The SAP note status „New“ and „New version available“ are pre-selected, other could be
added manually. Keep this in mind working with the note list.
▪ SAP notes marked “Kernel” in the corresponding field contain kernel corrections.
▪ Release dependent SAP notes are relevant for the system they addressed to and should be
implemented.
▪ For release independent SAP notes it is not technically possible to determine its relevance.
Check the relevance by your own.
▪ After setting additional filters click on “Search” button.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 69
System Recommendations in SAP Solution Manager 7.2
Integration with SAP Support Portal
Transaction
SM30_AGSSR_STATUS
Select at least one system for which you want to install a support package patch and choose
Actions → Show (JAVA) Support Package Patches
or
▪ use the Maintenance Planner to
prepare and run the update
Correction notes (Type C – containing vital corrections to the SAP Solution Manager core functions)
must be specified manually to be retrieved:
▪ Call transaction SM30_DNOC_USERCFG_SR
▪ In the field SYSREC_NOTE_TYPES add or remove the relevant values
Transaction
SM30_AGSSR_OSDB
▪ Mandatory configuration
(transaction SOLMAN_SETUP)
➢ System Preparation
➢ Infrastructure Preparation
➢ Basic Configuration
▪ Managed Systems
Configuration
(#) There is no special display-mode in System Recommendations. Both roles offer same functionality including
entering status and comments for notes
(*) As described in the role documentation you have to add an authorization proposal into the role menu.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 95
System Recommendations: Setup in SAP Solution Manager 7.2
Requires roles
If you are using a separate Fiori Hub you need to
generate the OData service for System
Recommendations using transaction
/n/IWFND/MAINT_SERVICE as described in the
Security Guide of the SAP Solution Manager (see
chapter 4.6.1 SAP Fiori Launchpad and NWBC).
Prerequisites:
- Configure profile parameters and redirect file for SAP Web Dispatcher
- Create Fiori Catalog with specific target mapping
- Create role containing the Fiori Catalog and assign it to all users
References:
Online Help - Setup of In-Application Help
https://help.sap.com/viewer/89a6c6256d8d4ae9b329e34c44607a32/106/en-US/879b33575fbb0950e10000000a441470.html
What's this App? You can group by system type and favorites.
What's this App? System Overview System Types Sort, Filter, and Group
This is the System Shows all the systems for Filter for a system type Display the systems that
Recommendation app. which system are relevant for you
recommendations are
available
Save as Tile
Save as Tile
Usage Count
Usage Count
Shows the Usage and
Procedure Logging data
Execution of Report:
1. Run report AGSNO_RPT_EASY_SUPPORT and choose the
system ID and the system type (e.g. ABAP or JAVA)
2. Save the generated xml file in your local directory.
You can inspect the xml file with any xml viewer.
3. Compress the xml file into a .zip file using the common
zip program
4. Create a support ticket on component SV-SMG-SR and
add the zip file as an attachment.
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 105
Troubleshooting: Support Tools for System Recommendations
Note 2418578 - Report to batch download solution manager trace files
Recommendation:
Implement side effect
solving notes right after
implementation of the
original notes
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 109
What‘s new in System Recommendations
If a Software Component is not part of ABAP / JAVA / HANA systems in SLD / LMDB you do not
find corresponding notes in System Recommendations.
CRYPTOLIB 8 SP000 added to ABAP and JAVA systems as a virtual software component
as of July 2017
User-defined Status
SAP Status
Customizing table
(fixed values) AGSNOTE_STATUS
Limitation: The Notes Search on SAP Support Portal https://support.sap.com/notes does not show a filter option for such notes
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 115
What's new in System Recommendations 7.2 SP 8
Support for Notes which are Relevant for System Measurement
Preparation, which only required if you have previously changed the customizing, i.e. to view
correction notes, too.
In this case you have to extend the settings via transaction SM30_DNOC_USERCFG_SR
for table DNOC_USERCFG
SYSREC_NOTE_TYPES HSLPCA
You can display the System Measurement and System Measurement ID columns on the SAP
Note Overview screen via the settings button:
LAW Consolidation
Note 2407507 - LAW 2.0 SDCCN transfer does not work to 7.31
Note 2164594 - LAW 2.0: Falsche Nutzertypen bei Konsolidierung
Note 2112104 - LAW 2.0: Fehlende Sortierfunktion im RFC STATUS
See Blog
How To Explore “Fiori Apps Reference Library”
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 120
Benefit of SAP Solution Manager System Recommendations
Limitation
The automatic analysis covers the software level but not new
options for security configuration
?
?
What code do I
use anyway?
SAP Kernel
Optimize Design
Custom Code
Lifecycle
Management
Build &
Operate
Test
Deploy
Report /SDF/SHOW_UPL
Work processes
Reports
Functions ABAP
Methods Code
Inspector
Procedures
* Default setting
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 127
SAP Usage and Procedure Logging (UPL)
Usage Analysis (local in managed system)
Solution Documentation
Once a day Assistant
System Recommendations
Week Month
etc.
BW Query 0SM_CCL_UPL_MONTH
System Recommendations
SAP CRM
DEV
TST UPL
1200
PRD 80
0
0
0
30
0
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 132
System Recommendations in SAP Solution Manager 7.2
Note Details: Integration with Usage Procedure Logging (UPL)
Analysis of Results
• Zero count in PROD system
• No explicit testing required as you are not using the programs (but you still should implement the notes)
• High count in PROD system and high count in TEST system
• No explicit testing required as you are executing the programs with normal activities in test environment
• High count in PROD system and zero count in TEST system
• You might need explicit testing
▪ SAP NetWeaver SAP_BASIS 7.01 SP10 or 7.02 SP9 (= SAP ERP 6.0 EHP4 or SAP ERP 6.0 EHP5)
▪ ST-PI 2008_1_700 SP4 or SP5 & Note 1683134 or ST-PI 2008_1_700 SP6 or higher
▪ Kernel 720 Patch 94 or higher according to …
▪ SAP Note 1785251 - SCOV/UPL: Error messages in monitor (Kernel 720 Patch 410 / 721 Patch 112)
▪ SAP Note 1822227 (to allow changing the data retention time using report /SDF/UPL_CONTROL )
▪ SAP Note 1906451 - Technical Preparation for Custom Code Management
▪ Based on our experience the space requirements are 2-10 MB for 14 days of data. So even data collection of
one year won´t massively affect space requirements. Nevertheless verify your individual storage settings /
database free space for a higher retention time value.
▪ Report /SDF/CONTROL shows the status of UPL:
The UPL activation procedure was subject of continuous enhancements in the SAP Solution
Manager infrastructure. Starting with many manual steps in SAP Solution Manager 7.1 SP5 it has
finally reached a fully guided and system supported version in SAP Solution Manager 7.1 SP 11.
The SOLMAN_SETUP scenario for Custom Code Management contains all necessary steps and
UIs to handle UPL configuration end to end including job scheduling of related UPL jobs.
See
Note 1955847 - UPL: Activation Procedure and Authorization Handling in SAP Solution Manager
Additional authorizations:
• S_COV_ADM with change activity
• S_RFC for function group /SDF/SCOV_LITE
➢ If UPL is not working ask for advice via application component SV-SMG-CCM-CDM
➢ If SysRec does not show existing usage data, create a ticket on application component SV-SMG-SR
➢ If report ZSYSREC_NOTELIST does not show existing usage data, send me a mail or comment on
https://scn.sap.com/community/security/blog/2011/07/18/report-zsysrecnotelist--show-results-of-system-recommendation
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 141
System Recommendations and UPL
Combined value
Retrieve affected objects from System Recommendations
Retrieve used objects via UPL
Compare both lists
If objects from a Security Note are not in UPL list:
Note will not affect running processes
Implement Security Note without testing
?
?
Which process is
affected, where to
test for side effects?
Pain Point Which critical business processes are affected by planned changes?
SAP Solution
Approach Update Change Impact Analysis Test Planning Test Execution
Solution Architect
impacted processes
A BPCA Change
Impact Analysis is
performed using the
top objects of the
planned development
against the business
processes for risk
assessment
Process
hierarchy
◼ Business scenario
◼ Business
processes
◼ Business steps
Sales
Quotation Delivery Billing
Business Scenario “Order to Cash” Order
execute
Tester starts Tester executes the process step in SAP Generated TBOM is assigned
manual test case managed System to Process Step / Business
from Tester Worklist while BPCA traces all SAP objects Process
used by the Process Step in the background
▪ Disadvantage: less precision compared to 2. Initial: Work-Item for Business User in PRD system
dynamic TBOMs due to limit to 4 branching levels Update: Manual Testers in TST system
3. Automatic generation via automated tests (eCATT,
SAP TAO, HP QTP, …)
Example:
Process Steps and Transactions for SD
Combined value
Run BPCA to know which technical objects are used
in which process
Hand over objects affected by SAP Security Notes
from System Recommendations to BPCA
Determine affected processes
Develop suitable test cases for side effects
Challenges
A large number of systems… Complex SAP Landscape …
… Need to perform comparison of current configuration status against a defined target or
standard configuration baselines
… with minimum efforts and ASAP
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 162
What is Configuration Validation?
The Idea behind Configuration Validation
A reporting to understand how homogeneous the configuration of systems is
Reference System Compared Systems
System 1 System N
Configuration Items
Software Packages
Configuration Items ... Configuration Items
Combined value
Run cross-system BW reporting about System
Recommendations
Validate if selected notes have reached production systems
Determine quality of patch processes
?
?
Whether to patch,
or not to patch?
➢ Depending on the age of the system very ➢ The effort to analyze and to implement security
many Security Notes (up to hundreds) are notes, to identity the test requirements and to
relevant per system document all activities is quite high
➢Describes organization (responsibilities) and processes relevant for implementing security patches
➢Defines the mandatory timelines for published security patches and implementation of SPs
➢Should provide hard targets but should also allow for documented, approved exceptions
➢Goal: Make patching mandatory but balance security risk against operational risk
Business first
No patching at all. Only exceptions are SPs
every 2 years (or less) or one or two “Hot
News” notes a year for severe vulnerabilities
Security first
No discriminating patching policy, no
assessments, trade-offs. Security Notes are
implemented immediately regardless of priority
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 180
Non-Trivial SAP Security Patch Policies
Business first
No patching at all. Only exceptions are SPs
every 2 years (or less) or one or two “Hot
News” notes a year for severe vulnerabilities
Security first
No discriminating patching policy, no
assessments, trade-offs. Security Notes are
implemented immediately regardless of priority
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 181
The patching process: Actions to take
1. Find the notes. Use SAP Support Portal and System Recommendations.
b) Special project to cover the backlog of old notes once the monthly patch process works fine
2. Classify the notes for the patching policy: Assess the security risk (i.e. priority & CVSS).
3. Classify the notes for the patching policy: Assess the implementation risk (UPL, BPCA).
3. Security Notes published by SAP must be assessed and classified by priority [Very High, High,
Medium, Low] and implementation process [Monthly, Maintenance, Project]
4. The following timelines System Class [Max] Note Priority Impl Process Deadline
apply (excerpt): Very High Very High <any> 30 days
Very High High Monthly 30 days
Very High High Maintenance 90 days
High High Project 180 days
……….
5. Exceptions are allowed for good reason but must be documented and approved by IT Security
© 2019 SAP SE or an SAP affiliate company. All rights reserved. 186
Sample patch process
Integrated approach with policy adoption and checks
Monthly on 2nd Within one month, three
The week after the Patch Day During next maintenance cycle
Tuesday months…
ASUG Security SIG English Wednesday 18:00-19:00 CEST = 12:00 EST = 9:00 PST
Calendar: https://www.asug.com/events#!/events/cal?keyword=Security&categories=webinar&period=month
SAP Enterprise Support Value Map Security / SAP Enterprise Support Academy
English Thursday 10:00-11:00 CET
To access the SAP Learning Hub, edition for SAP Enterprise Support, a one-time registration via an s-user is required. The registration triggers an
automatic eligibility check. Access is included in SAP Enterprise Support and SAP Enterprise Support, Cloud Edition as well as in SAP Product
Support for Large Enterprises.
The Patch Day Security Notes with ABAP corrections are supported by an impact analysis which will provide
information on which end user applications might be impacted by a given note.
This information enables customers to perform regression testing before patching the productive systems thereby
taking informed decisions and ensuring continuity of their processes.
The impact analysis is based on static analysis of dependencies performed internally at SAP on a standard
SAP system which is on the latest release. Custom coding is not supported.
The analysis currently supports dependencies related to Reports, Transactions, Remote-Enabled Functions (RFC)
and WebDynpro ABAP applications.
Testing recommendations
▪ Obsolete code: “Solution” columns
− When code is removed, it shouldn’t have been there right from the start
− High probability that this code had never been used in customer production either
▪ ABAP: Use UPL to measure object usage
− Performance impact negligible
− Reports /SDF/UPL_CONTROL, /SDF/SHOW_UPL
− UPL functionality is contained in ST-PI components
− Compare results with affected objects from advisory
▪ Objects that are not used might be used by an attacker. But patching is easy because no testing required.
By vulnerability type:
▪ Directory traversals: very often difficult to implement
A project approach is advisable for non-recent SP levels
Security risk depends highly on “read” vs. “write”
▪ Missing authorization: very often fairly easy to implement
(but watch out for objects that might be missing in roles)
▪ XSS: very often fairly easy to implement and test
▪ Code / SQL (write) / Command injection: dangerous! – and often easy to implement
▪ Information disclosure / SQL (read) injection:
No imminent danger to system integrity
Check “Additional comments” for implementation issues (dependent notes) and side effects
Some customers calculate time-to-patch on both implementation approach and security risk.
Key Message:
Absolute baseline security / first and most effective security measure against exploits and attacks.
The advisory team screens timely commercial as well as public security sources and filters relevant vulnerabilities.
All components used within SAP are in scope incl. SAP NetWeaver or SAP HANA patches.
Step • SAP Vulnerability Advisory Service provides SAP Security Note details on SAP Patch Day
1
Step • Central operation team in SAP IT reviews Advisory and related SAP Security Notes
2
Step • Creation of task list via application System Recommendations respective FRUN CSA Validation
3
Step • System Owner verifies task list and confirms list of to-be-implemented notes
4
• Implementation of Notes in Bugfixing Systems using the standard change management process incl.
Step creation of relevant master change tickets
5
• Import and testing is done based on criticality and rating of notes either via monthly release delivery
Step or via Emergency Change / Fast Track for Very Critical Patches.
6
Step • Tracking and reporting is done via FRUN CSA Validation (which is similar to Configuration Validation)
7
Frank Buchholz
SAP CoE Security Services
[email protected]
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its distributors contain proprietary software
components
of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP or its
affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP or SAP affiliate company products and services are
those that are
set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or
release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future
developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for
any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-
looking statements are subject to various
risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking
statements, and they should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate
company)
in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies.
See https://global.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.