V1.0 DevOps With GitHub On Microsoft Azure Advanced Specialization Audit Checklist
V1.0 DevOps With GitHub On Microsoft Azure Advanced Specialization Audit Checklist
Advanced Specialization
Program guide, audit checklist, and FAQ
Version 1.0
Contents
2
DevOps with GitHub on Microsoft Azure
advanced specialization
Program Overview
As the speed of business accelerates, your customers are looking for better, faster, smarter ways to
develop and deploy software and automated processes. They're moving away from traditional waterfall
development and embracing iterative development and delivery tools that help shorten time to market.
The DevOps with GitHub on Microsoft Azure advanced specialization differentiates your organization and
showcase your proven ability to implement secure DevOps practices while using Azure and GitHub.
The DevOps with GitHub on Microsoft Azure advanced specialization allows partners with an active Gold
Cloud Platform competency to further differentiate their organizations, demonstrate their capabilities, and
build stronger connections with customers.
After partners earn an advanced specialization, they will have a customer-facing label displayed on their
business profile, gain access to specific go-to-market programs, and be prioritized in customer searches in
the Microsoft Partner Directory. For these reasons, this opportunity is available only to partners that meet
additional, stringent requirements.
This document defines the requirements to earn the DevOps with GitHub on Microsoft Azure advanced
specialization. It also provides further requirements, guidelines, and an audit checklist for the associated
audit that is required to earn this advanced specialization.
When a partner meets all prerequisite requirements shown in Partner Center and Microsoft receives a
valid Pass Report from the third-party audit company, the partner will be awarded the DevOps with
GitHub on Microsoft Azure advanced specialization for one (1) calendar year.
The status and the DevOps with GitHub on Microsoft Azure advanced specialization label can be used
only by the organization (determined by Partner Center MPN PGA ID account) and any associated
locations (determined by MPN PLA ID) that met all requirements and passed the audit. Any subsidiary or
affiliated organizations represented by separate Partner Center accounts (MPN PGA ID) may not advertise
the status or display the associated label.
Audit information
The audit checklist will be updated to stay current with technology and market changes. The audit will be
conducted by an independent, third-party auditor.
Partners may apply for the audit only after all other program requirements have been fully met. Partners
must complete the audit within thirty (30) calendar days of the audit application, and they must complete
it against the then-current program requirements.
Partners will be awarded a Pass or No Pass result upon completion of the audit process, including if they
3
withdraw from the audit process. The Pass result is valid for one (1) calendar year.
Partners that receive a No Pass result will be locked out of reapplying for six (6) months. They may reapply
to be audited again at the end of this period, provided that they still meet all other program
requirements.
How to apply
Only administrators of an organization’s Microsoft partner account can submit an application for the
advanced specialization on behalf of the organization.
Partners with the appropriate role and access permissions can apply. To do so, they sign into their
Partner Center account. On the left pane, select Competencies, and then select Adv. Specialization.
4
Application phases
1. Prerequisite requirements
2. Audit
2 Validate that the partner meets all requirements prior to audit. Microsoft
3 Confirm to the third-party audit company that the partner is eligible for Microsoft
audit.
4 Schedule and confirm audit within two (2) business days. Auditor (with
partner)
5 Conduct the audit within thirty (30) calendar days of the approval for audit. Auditor
6 Provide a Gap Report to the partner within two (2) business days of the Auditor
completed audit, listing any Open Action Items.*
7 Within two (2) business days of receiving the Gap Report, the partner Partner
acknowledges receipt of the report and schedules a Gap Review
Meeting.
8 Within fifteen (15) calendar days of receiving the Gap Report, the partner Auditor (with
schedules the Gap Review Meeting with the auditor to provide partner)
evidence and address any Open Action Items.*
* These steps will be skipped if the partner has no Open Action Items after the audit.
5
Schedule your audit
Partners that meet all program prerequisites may apply for an audit in Partner Center by selecting
schedule audit. We recommend that partners first review the audit checklist in detail before applying for
the audit. Each partner must assess their ability to complete the audit, including considerations for
readiness, employee availability, and holidays. After a partner applies for the audit, it must be scheduled
and completed within thirty (30) calendar days. Failure to complete the audit in this time will result in an
automatic No Pass report, which is entered into Partner Center as Audit Failed.
After the partner applies to schedule the audit, Partner Center will issue an automated message that
connects the partner to ISSI. The partners will receive a communication from ISSI asking them to propose
dates for their audit.
The audit company will make every effort to accommodate the partner’s requested audit date and will
attempt to schedule an auditor in the region closest to the remote audit location. After the date and
auditor are confirmed, the partner will be given a detailed confirmation of the audit day.
* Please note that there is a cost associated with the audit. See Payment Terms and Conditions.
Prior to the audit, partners are expected to have undertaken a thorough review of the audit checklist,
compiled all required evidence, and ensured that the right subject matter experts (SMEs) are available to
present that evidence.
After the audit date has been confirmed, ISSI will provide an agenda to the partner. During the audit, the
partner must provide access to the appropriate personnel who can discuss and disclose evidence that
demonstrates compliance with program requirements. We highly recommend that subject matter experts
for each section attend.
On the day of the audit, the partner must be prepared to provide the auditor with access to live
demonstrations, documents, and personnel, as necessary to demonstrate compliance with the
requirements.
During the audit, the auditor will seek to verify that the partner’s evidence has addressed all required
audit checklist items satisfactorily.
• The auditor will present a brief synopsis of the audit. This will include identifying observed
strengths and opportunities for improvement.
2. The partner does not satisfy all checklist items during the audit.
6
• The auditor will present a brief synopsis of the audit at the end of the day, including observed
strengths and Open Action Items, as outlined in the Gap Report, within two (2) business days.
• The partner will acknowledge receipt of the Gap Report within two (2) business days.
• The partner will move into the Gap Review phase and schedule their Gap Review Meeting
within fifteen (15) calendar days.
Within two (2) business days after the audit, the partner will receive a Gap Report, which details any
Open Action Items and the outstanding required evidence. The partner then has two (2) business days
to acknowledge receipt of the Gap Report and schedule a Gap Review Meeting. The Gap Review
Meeting is conducted with the auditor over the partner’s virtual conference platform of choice. The
meeting must take place within fifteen (15) calendar days of when the Gap Report was sent, and it may
last no longer than one (1) hour. During the Gap Review Meeting the partner must present evidence
that addresses any and all Open Action Items.
• The auditor confirms that the partner has provided the required evidence.
• The auditor provides a Final Report to the partner.
• The auditor notifies Microsoft about the outcome (subject to Auditor Terms and Conditions).
• The auditor presents a brief synopsis of the audit, including missed items.
• The partner receives a Final Report that details the missed items.
• The auditor notifies Microsoft about the outcome (subject to Auditor Terms and Conditions).
If the partner is still unable to provide satisfactory evidence to the auditor during their Gap Review
Meeting, the partner will be deemed to have failed the audit. Partners that still want to earn this advanced
specialization will need to begin the application process again.
Alternatively, partners can participate in an optional, one-hour, live audit preparation overview session
7
provided by ISSI. This session provides a high-level overview of key aspects of the advanced specialization
audit process. The session includes a discussion of the checklist requirements along with best practices to
help partners prepare for the audit. Partners work directly with ISSI to schedule this remote session (via
online web conference). For more information about this session, see Azure Advanced Specializations -
Audit Preparation Overview.
To ensure objectivity, audits are conducted by a different ISSI auditor than the one that is engaged for
consulting. Consulting engagements can be scheduled at any time using the partner’s preferred
conferencing platform.
* Please note that there is a cost associated with the consulting and audit preparations services. See
Payment Terms and Conditions.
Audit checklists
The DevOps with GitHub on Microsoft Azure advanced specialization audit checklist contains two (2)
modules, Cloud Foundation and DevOps with GitHub on Microsoft Azure. Module A: The Cloud
Foundation module evaluates the use of a consistent methodology and process for Azure adoption that is
aligned with customers’ expected outcomes, spanning the entire cloud adoption lifecycle. Module B: The
DevOps with GitHub on Microsoft Azure module validates that the partner has adopted robust processes
to ensure customer success across all phases of deploying DevOps solutions, from the assessment phase
to design, pilot, implementation, and post-implementation phases.
Review the following audit checklist table for more details about each control phase and to learn how the
partner will be evaluated for an audit.
To pass the audit, the partner must complete all audit checklist items.
Module A: Cloud Foundation is required for multiple Azure advance specializations. To complete
Module A: Cloud Foundation, the partner needs to pass all controls in Module A by providing the
specified evidence. Alternatively, the partner may present evidence of a previous pass result from
Module A or from another advanced specialization audit conducted on V 2.0 or later.
8
Module B: DevOps with GitHub on Microsoft Azure. Each control has one (1) or more requirements
and required evidence the partner must provide for the auditor. Both the requirements and the
required evidence are defined in the following tables. For some controls, a reference customer or
customer evidence is the documentation requested.
Unless otherwise stated, the partner must show at least three (3) unique customers with deployments
completed within the last twelve (12) months.
The partner can use the same customer across audit checklist controls, or they can use a different
customer. For audit evidence relating to customer engagements, the partner can use a customer case
study and reference it multiple times.
The partner must have a defined approach for helping their customer evaluate and define a cloud adoption
strategy beyond an individual asset (app, VM, or data).
Requirement
1.1 The partner must have a process that captures the data-driven business strategies being used to
guide customer decisions. Their process should include, at minimum, the following:
• A strategy review for capturing the customer’s business needs and/or problems the
customer is trying to solve.
Required evidence:
A report, presentation, or document that captures strategic inputs and decisions for two (2) unique
customers, with projects completed in the past twelve (12) months that are aligned with the
process. For an example, see the Strategy and plan template in the Cloud Adoption Framework for
Azure.
2.0 Plan
The partner must have a consistent approach to planning for cloud adoption that is based on the strategy outlined
in the preceding section.
Requirement
2.1 The partner must have a process and approach for planning and tracking the completion of cloud
adoption projects. For an example of a cloud adoption plan, see the Azure DevOps Demo Generator
for the Cloud Adoption Framework.
Required evidence:
The partner must provide evidence of their capability with examples of two (2) unique customers,
9
with projects that were completed in the past twelve (12) months. Acceptable evidence must
include at leastone (1) of the following:
The partner must be able to demonstrate that the following design areas are addressed through their approach to
landing zone implementation.
Requirement
3.1 Repeatable deployment
The partner must demonstrate adherence to Azure landing zone design areas through a
repeatable deployment. The deployment should configure, at minimum, the following identity,
network, and resource organization attributes:
• Identity
o Adoption of identity management solutions, such as Azure Active Directory or
equivalent
• Resource organization
o Implementation of tagging and naming standards during the project
The partner should be able to demonstrate which of the following deployment velocity
approaches they use when they deploy Azure landing zones:
• Start small and expand: Azure landing zone does not deploy governance or operations
configurations, which are addressed later in the implementation.
Required evidence:
The partner must provide evidence of a repeatable deployment they use to create landing zones
that they have deployed to two (2) unique customer environments by using Azure Blueprints,
ARM templates, Terraform modules, or equivalent tools to automatically deploy the environment
10
configuration.
The provided template can be pulled directly from the provided implementation options, or it
can be based on the partner’s own IP. In either case, the script must demonstrate the
configuration of the identity, network, and resource organization, as described earlier.
4.0 Governance
The partner must demonstrate their customer’s role in governing cloud-based solutions and the Azure tools they
use to facilitate any government requirements their customer might have today or in the future.
Requirement
4.1 Governance tooling
The partner must demonstrate the ability to deploy the required governance tools for two
(2)unique customer projects.
Required evidence:
The partner must demonstrate the use of Azure Policy or equivalent tool to provide controls to
govern the environment for two (2) unique customers with projects that were completed in the
pasttwelve (12) months.
5.0 Manage
The partner must demonstrate that they have set up their customer for operational success after the deployment is
completed. All partners have a role in setting up operations management, even if they do not provide long-term
managed services.
Requirement
Required evidence:
The partner must demonstrate the deployment of at least one (1) of the following Azure products or
third-party equivalents: Azure Monitor, Azure Security Center, Azure Automation, or Azure Backup/Site
Recovery, for two (2) unique customers with projects that were completed in the past twelve (12)
months.
11
Module B: DevOps with GitHub on Microsoft Azure
Requirement
Required evidence:
The partner must demonstrate a documented approach for implementing DevOps for three (3)
customerswith completed projects using Azure and GitHub within the last twelve (12) months.
• A Practice charter document with clearly documented execution model and success criteria
• Organization documentation with dedicated Core Team/Architects and at least three (3)
DevOpsconsultants
• Customer assessment plan, for example: Assets like questionnaire, Assessment worksheets
templates
12
• Defined Governance Model document
• Offering or Accelerator for customer DevOps adoption and execution (minimum one (1)
offering)
• SOWs
2.0 Assess
The partner must have a consistent approach to assessing customer requirements for the workload.
Requirement
• Workshop template
• CI/CD Pipelines
• SecOps
• Test Cases
Required evidence:
The partner should provide relevant documents showing that the preceding items were reviewed for
one (1) customer with a DevOps on Azure project completed within the last twelve (12) months. The
evidence mustshow that all assessment details were considered for those customers. Assessments may
be done manually or through an industry-accepted assessment tool.
13
3.0 Design
Requirement
14
Automated provisioning in both pre-production and production environments
Roles and permissions describing who can access, modify and/or maintain
differentcodebases
Required evidence:
The partner should provide relevant solution design documents that address the preceding points as
appropriate, for at least three (3) unique customers with DevOps with GitHub on Azure projects that
were completed within the past twelve (12) months.
The partner must demonstrate the use of an Azure Well-Architected Review on workloads or
applications in Azure.
The Well-Architected Review is designed to help partners evaluate their customers' workloads against
the latest set of industry best practices. It provides actionable guidance to design and improve those
workloads. The review can be used to evaluate each workload against the pillars of the Azure Well-
Architected Framework that might apply to that workload.
Required evidence:
The partner must provide exported results from the completed Well-Architected Review, using the
assessments in the review for at least three (3) workloads or applications running in Azure that
were completed within the last twelve (12) months, indicating the customer's name. All five pillars
of the Well-Architected Review should be completed, otherwise the partner must provide
justification for an exception. The three (3) workloads can come from one (1) or more customers.
15
4.0 Delivery
The partner has robust methodologies for implementing GitHub and Azure in DevOps engagements.
Requirement
4.1 Delivery
The partner must provide evidence of their ability to embed GitHub into DevOps engagements.
Required evidence:
The partner must provide documentation for three (3) unique customers with engagements involving
DevOps that were completed within the last twelve (12) months.
• All three (3) engagements must use Git repositories to store engagement assets (e.g.,
application code, scripts, ML models, etc.), with at least one (1) engagement using GitHub
Enterprise (Cloud, Server or AE)
• All three (3) engagements implement continuous integration or similar automated build
strategy using GitHub Actions, Azure Pipelines, Jenkins, or CircleCI, with at least one (1)
engagement usingGitHub Actions
• At least one (1) engagement automatically performs code analysis to improve code security
and/or quality leveraging GitHub Advanced Security, SonarQube, SonarCloud, OWASP,
Veracode, Fortify, Parasoft, and/or Coverity, with at least one (1) engagement leveraging
GitHubAdvanced Security
• At least one (1) engagement protects branch code quality and compliance using GitHub
BranchProtections (GitHub)
• At least one (1) engagement leverages the GitHub dependency graph and
Dependabot to identify and remediate open-source vulnerabilities
• At least one (1) engagement provisions environments in Azure through GitHub Actions
usingARM Templates, Terraform, or Ansible.
To cover the entire sequence of the engagement, including design and production deployment, the
documentation must include at least two (2) of the following:
16
5.0 Review and release for operations
Requirement
• Demonstrating a process and approach to testing and evaluating the performance of all
applications against customer expectations and Azure best practices.
• Demonstrating a process and approach to evaluating and improving architectural best
practices to remediate issues with migrated platforms or workloads that do not meet
performance or cost expectations.
Required evidence:
Documentation of the testing, validation, and performance evaluation that addresses the preceding
points for three (3) unique customers with DevOps projects that were completed in the past twelve (12)
months.The documentation must indicate that the implemented solution met customer expectations,
and it must include a sign-off from the customer.
Required evidence:
Documentation that addresses the preceding points for three (3) unique customers with DevOps
withGitHub on Azure projects that were completed in the last twelve (12) months
17
Payment terms
The cost of the audit is payable in full to the audit company and must be settled before the audit begins.
Failure to pay will result in cancellation of the audit.
Roles
Role of the auditor
The auditor reviews submitted evidence and objectively assesses whether the evidence provided by the
partner satisfies the audit checklist requirements.
The auditor selects and evaluates evidence, based on samples of the information available from live
systems. The appropriate use of such sampling is closely related to the confidence that can be placed in
the audit conclusions.
All ISSI auditors are under a non-disclosure agreement (NDA) with Microsoft. Auditors will also comply
with requests from partners to sign a direct NDA.
18
Glossary
Audit
A half to full-day audit that is carried out remotely by a qualified ISSI auditor. During the audit, a partner
must present evidence of having completed 100 percent of the audit checklist items.
Gap report
Open Action Items are listed in the Gap Report, which is sent to partners within two (2) business days
after their audit. The Gap Report details all Open Action Items and the evidence that is still required.
Partners have two (2) business days to acknowledge receipt of the report and to schedule a Gap Review
Meeting.
Missed Item
If the auditor deems that the partner has failed to present the required evidence for an audit checklist
item during the Gap Review Meeting, this failure is recorded as a Missed Item and is included in the Final
Report.
Final Report
A Final Report is provided to partners that discusses whether they have earned a Pass or No Pass in the
audit. A Final Report showing a Pass can be issued at the end of either the audit or the Gap Review
Meeting. A Final Report showing a No Pass will be issued after the Gap Review Meeting. If a partner
chooses not to proceed to a Gap Review Meeting or fails to acknowledge receipt of the Gap Report, a
Final Report showing a No Pass result will be issued within five business days.
19
Partner FAQ: Audit
Program contact information
If you have a question that we have not answered in this document, contact Partner Center support.
In addition, there are indirect costs associated with preparation for the audit.
How much time and how many resources (people) do we need to commit to meeting the
requirements?
The amount of time it takes to meet all requirements and pass the audit varies greatly. It depends on how
many of your current employees already have the required Azure skills, whether they have documented
customer wins, and how you document your people, technology, and processes.
Important notes
Do not apply for the program until you have met all the program requirements prior to the audit. Be sure
you have thoroughly reviewed the audit requirements and are confident you can satisfy them.
Take note of the active dates for the audit checklist. Partners are audited against the checklist items that
are active on the date of their half to full-day remote audit. The original application date has no bearing
on the version of the checklist that is used for the audit.
20
In which languages are the audits conducted?
• English
• Portuguese
• Spanish
• French
• German
• Italian
• Serbian
• Croatian
• Russian
• Hebrew
• Mandarin
• Japanese
• Korean
• Arabic
21
How is the audit scored?
The partner score for the audit checklist is based on the checklist controls. To pass the audit, partners
must complete all sections in each control area. They must provide adequate evidence to demonstrate the
existence, effectiveness, and efficiency of their processes, policies, procedures, and tooling against each
checklist item.
Audit process
Who conducts the audit?
The audit is carried out on behalf of Microsoft by an independent, third-party auditor, appointed by
Microsoft. The audit company is Information Security Systems International (ISSI).
Can I contact the auditor to schedule the audit before I apply or as soon as I apply?
No. The audit company, ISSI, cannot schedule your audit until it receives an official notification from
Microsoft. Microsoft will issue the notification only after you have shown that you meet all program
requirements and you have applied for an audit by selecting “schedule audit” from the Partner Center
dashboard. ISSI will reach out to you to begin the scheduling process within one to two (1-2) business days.
22
How long does the audit take?
The remote audit takes about a half to a full-day. However, significant preparation is required to be audit-
ready. We recommend that you read the audit checklist thoroughly and, to streamline your preparation,
consider the consulting and audit preparation overview offered by ISSI.
What is the difference between the audit and the consulting and audit preparation?
Consulting and the Audit Preparation Overview are optional and conducted by the third-party audit
company, ISSI. The purpose is to help partners prepare for the audit.
To ensure objectivity, audit preparation consulting is conducted by someone other than your assigned
remote auditor. You can schedule consulting engagements at any time by using your preferred
conferencing platform.
23
Partner FAQ: Advanced specialization overview
What is an advanced specialization?
An advanced specialization is an extensive validation of a partner’s capability to deliver high-fidelity
services in a specific solution area. Advanced specializations are customer-facing labels displayed on a
partner’s business profile. They are used in our customer referral engine to allow partners to showcase
their differentiated capabilities in a specific solution area. To earn an advanced specialization, partners
must first hold gold competency status in an aligned competency.
24
Can a partner have more than one advanced specialization?
Yes, if you qualify, you can earn as many advanced specializations as you choose. Earning additional
advanced specializations will increase your visibility to customers in the Partner Finder tool.
In addition, there are indirect costs associated with preparation for the audit, including audit preparation
hours.
Do partners need to requalify for the advanced specialization after a specific period of time?
Yes. Partners must meet the requirements each year. You should expect the requirements to evolve year
over year, to best meet the needs of customers. Partners will be expected to undergo an annual audit as
part of the renewal process.
What happens to the advanced specialization if a partner does not renew their associated gold
competency?
To maintain an advanced specialization, partners must keep their gold competency status active at all
times.
25
What can partners tell customers about advanced specializations?
An advanced specialization is a customer-facing label on your Business Profile. It is not a brand, and it
does not have a badge associated with it. However, you can tell your customers which advanced
specializations you have earned. They can validate by reviewing your Business Profile in the Partner Finder
tool.
Can a company have both an endorsement and an advanced specialization on its profile?
No. As advanced specializations go live, they replace endorsements on the customer-facing Partner
Profile.
Does a partner get a badge to use externally in their marketing to differentiate their advanced
specialization?
Advanced specializations do not have a badge or a logo. An advanced specialization is a label that is
displayed on the partner’s customer-facing Partner Profile.
Other questions?
If you have any questions that we have not answered in this document, go to Partner Center support to
create a ticket with our Frontline team.
26