0% found this document useful (0 votes)
314 views29 pages

V1.4 AI and ML On Microsoft Azure Specialization Checklist, Program, FAQ

This document defines the requirements to earn the AI and Machine Learning on Microsoft Azure specialization. It provides guidelines and audit checklists for the associated audits required to earn this Azure specialization. Partners must demonstrate deep knowledge, extensive experience, and proven success in planning and deploying AI/ML on Azure. The specialization allows partners to further differentiate and build stronger customer connections.

Uploaded by

taha
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
314 views29 pages

V1.4 AI and ML On Microsoft Azure Specialization Checklist, Program, FAQ

This document defines the requirements to earn the AI and Machine Learning on Microsoft Azure specialization. It provides guidelines and audit checklists for the associated audits required to earn this Azure specialization. Partners must demonstrate deep knowledge, extensive experience, and proven success in planning and deploying AI/ML on Azure. The specialization allows partners to further differentiate and build stronger customer connections.

Uploaded by

taha
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 29

AI and Machine Learning on Microsoft Azure Specialization

Program guide, audit checklist, and FAQ

V1.4 Checklist
Valid July 5, 2023 -Jan 2, 2024
Program updates and announcements
Module B - July 5, 2023
V1.4 AI and ML on Microsoft Azure Specialization checklist is published. This checklist version is
required for audits July 5, 2023 – Jan 2, 2024

Updates to Control 1.1: under the AI Powered App option, Azure Cognitive Services have been called out.
For Cognitive Search, the ability to price is added in the control option. For Cognitive Search advanced
features, vector search is now an optional choice for evidence

Azure Innovate has been added for this specialization’s program benefits – see the FAQ on page 22

Module B- Jan 2, 2023


V1.3 AI and ML on Microsoft Azure Specialization audit checklist is published. This checklist version
is required Jan 2, 2023- June 30, 2023

Module B- Dec 5, 2022


The PREVIEW for V1.3 AI and Machine Learning on Microsoft Azure Specialization was made
available for partners.
There are no new Module A or B Control updates
FAQ updates include the clarification that a “No Pass” results when a partner fails or withdraws from the
audit. This status resets from “Audit Failed” within one week to “Not Enrolled,” for partners to reapply.

Module B- Oct 3, 2022


Microsoft retired Gold Cloud partner competency, Solutions partner designation required Gold &
Silver competencies are retired and replaced with Solutions Partner designations. Azure specialization
requirements are associated with your achievement of a required Solutions Partner designation. For this
specialization, your organization must have an active Solutions Partner for Data & AI (Azure) designation. Partners
have until the anniversary date of their specialization to attain the required aligned Solutions Partner designation
along with the other specialization requirements.

Module A - July 1, 2022


Checklist updates published May 2, 2022 in preview for the Module A audit checklist are now
required. In Control 2.2, a new required Skilling Plan has been added to the checklist.

Module B - July 1, 2022


Checklist updates published May 2, 2022 in preview for the Module B workload, AI and
Machine Learning on Microsoft Azure advanced specialization audit checklist V1.0.1 had
changes now required in V1.1, changes include control 2.1
The Solution Design Control 2.1 has added best practices for Responsible AI. This includes a “read and review”
acknowledgement of Microsoft’s RAI Standards and a new Impact Assessment Template for any AI system being
created. This is required July 1, 2022

2
Module B- May 2, 2022
1. Guidance for the definition of Proof of Concept and Pilots added to the FAQ
2. Preview updates to Module A were made available, these are required July 1, 2022

Module B- Feb 25, 2022


Clarification updated for Module B 1.1 Portfolio Assessment evidence

Jan 1, 2022
Guidance and FAQ Updates

3
Contents

AI and ML on MSFT Azure Specialization Program Overview ................................................................... 5


How to apply................................................................................................................................................... 5
NDAs for the audit........................................................................................................................................... 6
Payment terms and conditions........................................................................................................................6
Audit blueprint ................................................................................................................................................ 7
Audit roles .......................................................................................................................................................7
Audit Process: High-level overview ................................................................................................................8
Audit Process: Details ......................................................................................................................................9
Audit preparation best practices and resources ............................................................................................. 9
Audit checklists ............................................................................................................................................. 11
Partner FAQ ................................................................................................................................................... 23

4
AI and Machine Learning on Microsoft Azure Program Overview

This document defines the requirements to earn the AI and Machine Learning on Microsoft Azure
specialization. It also provides further requirements, guidelines, and audit checklists for the
associated audits required to earn this Azure specialization.

The AI and Machine Learning on Microsoft Azure specialization is designed for partners to demonstrate
their deep knowledge, extensive experience, and proven success in planning and deploying AI and Machine
Learning on Microsoft Azure cloud for their customers. Such partners empower their customers to deploy
AI cognitive services and machine learning solutions, from the assessment phase to design, pilot,
implementation, and post-implementation phases to realize the full breadth of these transformative,
secure solutions at enterprise scale.

The AI and Machine Learning on Microsoft Azure specialization allows partners with an active Solutions
Partner designation to further differentiate their organizations, demonstrate their capabilities, and
build stronger connections with customers.

Partners who meet the comprehensive requirements to earn an Azure specialization, receive a
customer-facing label they can display and a business profile in Microsoft AppSource partner gallery. In
AppSource, access to specific Microsoft go-to-market programs is prioritized in customer searches to help
drive new business. Partners can also generate a certified letter from Microsoft that verifies the Azure
specialization that they have earned. For these reasons, this opportunity is available only to partners that
meet additional, stringent requirements.

Partners will receive a Pass or No Pass result upon completion of the audit process. A Pass result satisfies
the audit requirement for this Azure specialization for two (2) years. A No Pass result is generated when
a partner fails or withdraws from the audit. When a No Pass result is entered into Partner Center, you
will see your status as Audit Failed. Your status will reset after one week, allowing you to apply again.

How to apply

Partners with the appropriate role and access permissions can apply. To do so, they sign into their
Partner Center account. On the left pane, select Azure under the Specialization section. Toggle to the
specialization that you wish to apply for by using the drop-down menu at the top of the page.

5
Important: Take note of the audit effective dates and access the most current version from Partner Center.
(Audit checklists are updated twice a year). Partners audit on the version that is live on their audit date,
not the application date.
Partners may apply for the audit only after all other program requirements have been fully met. Partners
must complete the audit within thirty (30) calendar days of the audit application, and they must complete
it against the then-current program requirements.

NDAs for the audit

Auditors comply with requests from partners to sign a direct NDA. All ISSI auditors are under a
nondisclosure agreement (NDA) with Microsoft. If a partner would like an NDA to be signed directly
between ISSI and the partner organization for purposes of the audit, one can be provided by the partner
during the audit scheduling process to ISSI. ISSI will sign and return it.

Payment terms and conditions


Pricing schedule

Module B Audit: $2,000 USD

Module A+B Audits: $3,000 USD

A Gap Review Meeting is included with each Module audit.

Payment terms

The cost of the audit is payable in full to the audit company and must be settled before the
audit begins. Failure to pay will result in cancellation of the audit.

Program status term

When a partner meets all prerequisite requirements shown in Partner Center and Microsoft receives a
valid Pass Report from the third-party audit company, the partner will be awarded the AI and Machine
Learning on Microsoft Azure specialization for one (1) calendar year.

The status and the AI and Machine Learning on Microsoft Azure specialization label can be used only by
the organization (determined by Partner Center MPN PGA ID account) and any associated locations
(determined by MPN PLA ID) that met all requirements and passed the audit. Any subsidiary or affiliated
organizations represented by separate Partner Center accounts (MPN PGA ID) may not advertise the
status or display the associated label.

6
Audit blueprint

Audits are evidence-based. During the audit, partners will be expected to present evidence they have met
the specific requirements on the checklist. This involves providing the auditor with access to live
demonstrations, documents, and SME personnel to demonstrate compliance with checklist requirements.
The audit checklist will be updated to stay current with technology and market changes, and the audit is
conducted by an independent, third-party auditor.

The following is included in the audit blueprint:


1. Audit Roles
2. Audit Process: High level overview
3. Audit Process: Details
4. Audit Best practices and resources

Audit roles
Role of the auditor

The auditor reviews submitted evidence and objectively assesses whether the evidence provided by the
partner satisfies the audit checklist requirements.

The auditor selects and evaluates evidence, based on samples of the information available from live
systems. The appropriate use of such sampling is closely related to the confidence that can be placed in the
audit conclusions. All ISSI auditors are under a non-disclosure agreement (NDA) with Microsoft. Auditors
will also comply with requests from partners to sign a direct NDA.

Role of the partner

The partner must provide objective evidence that satisfies the auditor for all checklist items. It is the
responsibility of the partner to have reviewed all checklist items prior to the audit, to have collated all
necessary documentation and evidence, and to have ensured that the right subject matter experts are
available to discuss and show systems, as appropriate. All audit evidence must be reproducible and
verifiable.

Role of the Microsoft Partner Development Manager

For partners that have an assigned Microsoft Partner Development Manager (PDM), the PDM is responsible
for ensuring that the partner fully understands the requirements prior to applying for the audit. The PDM
may attend the optional consulting engagements that ISSI offers, but the PDM and other Microsoft FTEs
may not attend the audit.

7
Audit Process: High-level overview

Step Action Responsibility

1 Review: Specialization requirements in Partner Center. Review Partner


audit checklists in the specialization and begin to prepare needed
evidence with personnel for an evidence-based audit.
Recommended: Before you apply, review the specific audit checklist
thoroughly and confirm SME personnel.

2 Meet the prerequisites and apply for the audit: In the initial Partner
application phase, applications are submitted in two (2) stages:
1. Prerequisite requirements (see Partner Center for details)
2. Audit

Do not start the application process unless you are ready to


undertake the audit. Assess your firm’s ability to complete the
audit, including considerations for readiness, employee availability,
and holidays.
3 Validate: The partner meets all requirements prior to audit. Microsoft

4 Confirmed by Microsoft: Microsoft confirms to the third-party Microsoft


audit
company that the partner is eligible for audit.

5 Schedule with partner: The auditor will schedule within two(2) Auditor (with
business days. partner)

6 Conduct the audit: Within thirty (30) calendar days of the approval Auditor
for
audit.

7 Provide a Gap Report: If applicable, to the partner within two (2) Auditor
business days of the completed audit, listing any Open Action
Items. *
8 Acknowledge Gap Report receipt and schedule meeting: Partner
Within two (2) business days of receiving the Gap Report, the
partner acknowledges receipt of the report and schedules a Gap
Review Meeting. Partners can begin immediate remediation of
open items.
9 Complete the meeting: Within fifteen (15) calendar days of Auditor (with
receiving the Gap Report, the partner schedules and completes partner)
the Gap Review Meeting with the auditor to provide evidence
and address any Open Action Items. *
10 Issue Final Report: To the partner within five (5) business days. Auditor
Notify Microsoft of audit Pass or No Pass result.

11 Notify the partner: About program status within two (2) business Microsoft
days.

* These steps will be skipped if the partner has no Open Action Items after the audit.

8
Audit Process: Details

Microsoft uses an independent, third-party audit company, Information Security Systems International,
LLC (ISSI), to schedule and conduct Azure specialization audits. After the audit date has been
confirmed, ISSI will provide an agenda to the partner. The duration of an audit is four (4) hours for
Module B workloads and eight (8) hours for Module A+B audits combined, depending upon the scope
of the audit.

During the audit, the partner must provide access to the appropriate personnel who can discuss and
disclose evidence that demonstrates compliance with program requirements. We highly recommend that
subject matter experts for each section attend as well as a person who is familiar with the entire audit.
On the day of the audit, the partner must be prepared to provide the auditor with access to live
demonstrations, documents, and personnel, as necessary to demonstrate compliance with the
requirements. During the audit, the auditor will seek to verify that the partner’s evidence has addressed all
required audit checklist items satisfactorily.

A note on audit checklist effective dates: Partners are audited against the checklist items that are active on
the date of their remote audit, not the date they apply. Audits are updated twice annually. The partner
application or renewal date has no bearing on the version of the checklist that is used for the audit.
The audit can produce either of two (2) outcomes:

1. The partner passes the audit.

• The auditor will present a brief synopsis of the audit. This will include identifying
observed strengths and opportunities for improvement.
• The auditor will provide a Final Report to the partner.
• The auditor will notify Microsoft.

2. The partner does not satisfy all checklist items during the audit.

• The auditor will present a brief synopsis of the audit at the end of the day, including observed
strengths and Open Action Items, as outlined in the Gap Report, within two (2) business days.
• The partner will acknowledge receipt of the Gap Report within two (2) business days.
• The partner will move into the Gap Review phase and schedule their Gap Review Meeting
within fifteen (15) calendar days.

The Gap Review

If the partner does not, to the auditor’s satisfaction, provide evidence that meets the required scores across
all audit categories during the audit, the partner will move into a Gap Review. A Gap Review is part of the
audit and completes the process.

Within two (2) business days after the audit, the partner will receive a Gap Report, which details any Open
Action Items and the outstanding required evidence. It is suggested to begin remediation on any open
action items as soon as possible following the audit.

9
The partner then has two (2) business days to acknowledge receipt of the Gap Report and schedule a Gap
Review Meeting. The Gap Review Meeting is conducted with the auditor over the partner’s virtual
conference platform of choice. The meeting must take place within fifteen (15) calendar days of when the
Gap Report was sent, and it may last no longer than one (1) hour. During the Gap Review Meeting the
partner must present evidence that addresses any and all Open Action Items.

The Gap Review Meeting can produce either of two (2) outcomes:

1. The partner resolves all Open Action Items.


• The auditor confirms that the partner has provided the required evidence.
• The auditor provides a Final Report to the partner.
• The auditor notifies Microsoft about the outcome (subject to Auditor Terms and Conditions).
2. The partner does not resolve all Open Action Items.
• The auditor presents a brief synopsis of the audit, including missed items.
• The partner receives a Final Report that details the missed items.
• The auditor notifies Microsoft about the outcome (subject to Auditor Terms and Conditions).
If the partner is still unable to provide satisfactory evidence to the auditor during their Gap Review
Meeting, the partner will be deemed to have failed the audit. Partners that still want to earn this Azure
specialization will need to begin the application process again.

Completion of the audit

The audit process concludes when ISSI issues the Final Report after the audit or after the Gap Review.
Partners will be awarded a Pass or No Pass result upon completion of the audit process, including if they
withdraw from the audit process.

Audit preparation best practices and resources


Partners should ensure that the audit checklist has been thoroughly read in advance of the audit

• Partners should ensure that all partner stakeholders involved have a copy of the audit checklist
and that a stakeholder who knows the entire process is available for the duration of the audit
• Partners should confirm that they have live access granted, and files and tools are readily
available during the audit exhibits

Stakeholder SME attendance in the audit

Stakeholders who can best address the relevant section should be available for the audit. However, please
make sure that a stakeholder who knows the entire process is available for the duration of the audit.
Auditors often probe for more information

The auditor probes for more information to ensure that mature and repeatable processes are in place with
the partner and that they are established, effective, and efficient.

10
The auditor is looking to see how a document was created, where it is located, and what source
materials were used to create the document. By probing for more information, the auditor evaluates
and validates that the partner is operating at an advanced level. This can only be done by questioning
during the audit. This approach is explained to the partner during the opening meeting.
Acceptable evidence: Excerpts, exhibit file formats and use of PowerPoints

PowerPoints are a common and accepted format for presenting a high-level overview of a partner’s systems.
However, please also be prepared to present live demonstrations from source files so that the auditor may
confirm that the systems in place are mature and effective. Excerpts can be used to communicate the high-
level overview but are not acceptable evidence, source documents must be presented.

Additional resources: Two optional audit preparation offers from the auditing firm*

To ensure objectivity, consulting auditors and auditors conducting the actual audits are different ISSI auditors.

1. Partners can participate in an optional, one (1)-hour, live Audit Process & Controls Overview session provided by
ISSI. This session provides a high-level overview of key aspects of the Azure Specialization audit process. The
session includes a discussion of the checklist requirements along with best practices to help partners prepare for
the audit. Partners work directly with ISSI to schedule this remote session (via online web conference). For more
information about this session, see Azure Specialization - Audit Process and Controls Overview

2. ISSI also provides optional extensive, in-depth consulting engagements to help partners prepare for their Azure
specialization audit. Partners work directly with ISSI to schedule this remote session (via online web conference).
For more information about this type of in-depth engagement, see Azure Specialization Consulting Offer
https://issi-inc.com/az-advspeconsulting/
* Please note that there is a cost associated with the consulting and audit preparations services. See Payment Terms and
Conditions.

Audit checklists

The AI and Machine Learning on Microsoft Azure specialization audit checklist contains two (2) modules,
Module A: Cloud Foundation and Module B: AI and Machine Learning on Microsoft Azure workload.

Module A, The Cloud Foundation module evaluates the use of a consistent methodology and process for
Azure adoption that is aligned with customers’ expected outcomes, spanning the entire cloud adoption
lifecycle. Module B, The AI and Machine Learning on Microsoft Azure module validates that the partner has
adopted robust processes to ensure customer success across all phases of deploying AI cognitive services
and machine learning solutions, from the assessment phase to design, pilot, implementation, and post-
implementation phases.

Review the following audit checklist tables for more details about each control phase and to learn how the
partner will be evaluated for an audit. The same customers may be used for Module A & B. The estimated
length of both modules together is eight (8) hours.

11
Module A: Cloud Foundation
1. Strategy
2. Plan
3. Environment readiness and Azure landing zone
4. Governance
5. Manage

Module B: AI and Machine Learning on Microsoft Azure


1. Assess
2. Design & POC/Pilot
3. Deployment
4. Review and release for operations

To pass the audit, the partner must complete all audit checklist items.

Module A, Cloud Foundation is required for multiple Azure specializations. To complete Module A:
Cloud Foundation, the partner needs to pass all controls in Module A by providing the specified
evidence. Alternatively, the partner may present evidence of a previous pass result from Module A
or from another Azure specialization audit conducted on V2.0 or later. Partners who have passed
an Azure specialization audit before July 1, 2021 and for the Analytics on Microsoft Azure
specialization audit before Oct 1, 2021, have likely not passed the Module A audit and will need to
do so to qualify for the Module B workload audits.
Module B, AI and Machine Learning on Microsoft Azure workload. Each control has one (1) or
more requirements and required evidence the partner must provide for the auditor. Both the
requirements and the required evidence are defined in the following tables.

For some controls, a reference customer or customer evidence is the documentation requested. Unless
otherwise stated, the partner must show at least three (3) unique customers with deployments completed
within the last twelve (12) months. Please note some checklists call for four (4) customer examples. The
partner can use the same customer across audit checklist controls, or they can use a different customer. For
audit evidence relating to customer engagements, the partner can use a customer case study and reference it
multiple times. The same or different customers can be used for Modules A & B if they demonstrate
requirements.

12
Module A: Cloud Foundation

1.0 Strategy and Economics

The partner must have a defined approach for helping their customer evaluate and define a cloud adoption strategy
beyond an individual asset (app, VM, or data).

Requirement

1.1 Cloud Adoption Business Strategy


The partner must have a process that captures the data-driven business strategies being used to
guide customer decisions. The process should include, at minimum, the following:

• A strategy review that captures the customer’s business needs and the
problems the customer is trying to solve

• Personalized recommendations from the partner for the customers’


business strategies

Required evidence:
A Report, Presentation, or Document that captures strategic inputs and decisions for two (2) unique
customers, that demonstrates Cloud Adoption Strategy Evaluator assessment output, with projects
completed in the past twelve (12) months. These projects must be aligned with the above-described
process and highlight both customer Business and Financial outcomes.

For an example, see the Strategy and plan template in the Cloud Adoption Framework for Azure, or
the Cloud Adoption Strategy Evaluator.

2.0 Plan

The partner must have a consistent approach to planning for cloud adoption that is based on the strategy outlined in
the preceding section.

Requirement

2.1 Cloud Adoption Plan


The partner must have a process and approach for planning and tracking the completion of cloud
adoption projects. For an example of a cloud adoption plan, see the Azure DevOps Demo Generator
for the Cloud Adoption Framework.
Required evidence:
The partner must provide evidence of their capability with examples of two (2) unique
customers, with projects that were completed in the past twelve (12) months. Acceptable
evidence must include at least one (1) of the following:

• Cloud Adoption Plan Generator output or


• Azure DevOps backlog or
• Any other tools for project planning and tracking

13
2.2 Plan for Skilling
When customers adopt the cloud, their existing technical staff will need a variety of new skills to aid
in making technical decisions and to support the new cloud implementations. To ensure the long-
term success of the customer, the partner must document a skilling plan to prepare the customer’s
technical staff.

The Partner must document a list of key customer technical roles expected to require new skills such
as, but not limited to, IT Admins, IT Governance, IT Operations, and IT Security.
The documentation must include:
A description of the new skills the technical roles will need to achieve to successfully manage
the new environment.
Resources the customer can leverage when training their technical employees such as
Microsoft learning paths, technical certifications, or other comparable resources.

For guidance, review Microsoft docs Azure Cloud Adoption Framework How to build a skilling
readiness plan.

Required evidence:
The partner must provide a skilling plan for at least two (2) unique customer engagements
completed within the last 12 months. The two (2) skilling plans documentation can include a
customer-facing presentation, planning documents, post deployment documentation or similar plan
documentation.

14
3.0 Environment Readiness and Azure Landing Zone

The partner must be able to demonstrate that the following design areas are addressed through their approach
to landing zone implementation.

Requirement

3.1 Repeatable Deployment


The partner must demonstrate adherence to Azure landing zone design areas through a repeatable
deployment. The deployment should configure, at minimum, the following identity, network, and resource
organization attributes:

• Identity
o Adoption of identity management solutions, such as Azure Active
Directory or equivalent

• Networking architecture design (topology)


o Define an Azure network topology - Cloud Adoption Framework | Microsoft Docs
o Application of hybrid architectures that use Azure ExpressRoute, VPN Gateway,
or equivalent services for connecting local datacenters to Azure

• Resource organization
o Implementation of tagging and naming standards during the project
The partner must demonstrate which of the following approaches they used when they deployed Azure
landing zones:

1. Start small and expand: Azure landing zone does not deploy governance or
operations configurations, which are addressed later in the implementation.

2. Full Azure landing zone conceptual architecture: Azure landing zones implement standard
approach to the configuration of governance and operations tools prior to
implementation.

3. Alternative approach: If the partner follows a proprietary approach or a mixture of the two
(2) approaches above, the partner must clearly articulate their approach to environment
configuration.

Required evidence:
The partner must provide evidence of a repeatable deployment they used to create landing zones
aligned to the Azure landing zone conceptual architecture or equivalent complete architecture deployed
to two (2) unique customer environments using Bicep, ARM (AZURE Resource Manager) templates,
Terraform modules, or equivalent tools to automatically deploy the environment configuration.
If a customer deviates from specified architecture, the partner must demonstrate the customer
requirements to justify the deviation.

The provided template can be pulled directly from the implementation options, or it can be based on
the partner’s own IP (Intellectual Property). In either case, the script as evidence must demonstrate the
configuration of the identity, network, and resource organization, as described earlier.

4.0 Governance

The partner must demonstrate their customer’s role in governing cloud-based solutions and the Azure tools
they use to facilitate any governance requirements their customer might have today or in the future.

15
Requirement

4.1 Governance Tooling


The partner must demonstrate the ability to deploy the required governance tools for two (2)
unique customer projects.

Required evidence:
The partner must demonstrate the use of Azure Policy or equivalent tool to provide controls to govern
the environment for two (2) unique customers with projects that were completed in the past twelve
(12) months.

5.0 Manage

The partner must demonstrate that they have set up their customer for operational success after the deployment is
completed. All partners have a role in setting up operations management, even if they do not provide long-term
managed services.

Requirement

5.1 Operations Management Tooling


The partner must demonstrate the use of Azure products or equivalent to help their customer and/or
managed service provider operate the environment after deployment.

Required evidence:
The partner must demonstrate the deployment of at least one (1) of the following Azure products or
third-party equivalents: Azure Monitor, Azure Automation, or Azure Backup/Site Recovery, for two (2)
unique customers with projects that were completed in the past twelve (12)
months.

Module B: AI and Machine Learning on Microsoft Azure specialization workload

1.0 Assess
Partner must have a consistent approach for assessing customer requirements for AI solution.
Requirement

16
1.1 Portfolio Assessment
The partner must demonstrate how they assess current state and customer requirements to ensure
adequate pre-deployment planning and sizing are performed. The Assessment must include:

• Requirements need analysis:


Partner must have a demonstrated approach for helping customers understand the
clear AI requirements in relation to their business goals. For example:
 Is the challenge suitable to use AI or rules to resolve? If the challenge has
enough features and weak certainty, is it suitable to use AI to resolve?

• Business need identification: Partner must document the following:


 Current pain points, challenges, expected ROI, and end user needs
 Product fit and gaps to identify which product will best serve the customer’s needs
 Data governance and compliance requirements
 Security requirements
 Budget requirements
 Ethics, responsible use, and other requirements around AI

• AZURE AI Solution Identification: The partner must document the following:


 Primary AI / ML use cases
 Current infrastructure or greenfield physical infrastructure
 Logical architecture and requirements
 Data storage needs from a business standpoint – volume, type, location,
current state vs. future state
 MLOps/AIOps process and key KPIs to measure (data drift, audit etc.)
 ML Model requirements and success metrics
 Solution performance requirements and data requirements.
 User roles, security requirements and how each will use and access the data
 Existing infrastructure/networking components that will connect to Azure

• Data needs: At the workload level, the partner must document which data needs
must be fulfilled to meet stated business requirements around data:
 Classification and risk of data involved – explain if any masking techniques was applied
 Identify data sources (on-premises, AWS, Google, etc.) and
destination (data storage on Azure)
 Identify who or what services should consume the data

• Security and Compliance needs: Partner must document the following customer needs:
 Identity and access management, role-based access control,
encryption, industry, and geography-centric compliance requirements,
if applicable.

In addition, the partner must demonstrate assessment capability across at least one (1) of the below
practice specialties in either Machine Learning or AI Powered Applications. All controls under each
specialty must be demonstrated in evidence.

• Machine Learning Lifecycle (competency in building custom machine learning).


Assessment must include requirements for:
 Data drift, training, and retraining scenarios
 Inference requirements (real time and / or batch)
 Data sets available, data dictionary, data set profiles
 Assess and document the required ML Lifecycle and ML Ops roles and processes

• AI-Powered Apps (competency in applying cognitive services such as (Azure Open AI Service,
Vision, Speech, Language, or Decision) Cognitive search, or customizing existing algorithms in
cloud-native apps).
17
• Assessment must include:
 Success criteria for Cognitive service use cases (e.g., accuracy threshold) Data
requirements and data labelling requirements
 Performance, load, throughput, and transaction requirements
 Usage option (Container vs Azure host)
 Cognitive search: Ability to appropriately price, size and scale solution to
meet storage capacity, query performance and throughput needs
 Cognitive search: Experience with both Push and Pull data ingestion methods
 Cognitive search: Usage of advanced search features such as: vector
search, scoring profiles for search relevancy, synonym mapping and/or
custom skill development

Required evidence:
The partner should provide relevant documents showing that the preceding items were reviewed for at
least three (3) unique customers, with projects that were completed within the last twelve (12) months.
The evidence must show that all above assessment details were considered for each customer. Assessments
may be done manually or through an industry-accepted assessment tool.

Accepted Documentation: Any of the following:


 An Assessment Report, an Assessment Checklist, Templates, Questionnaires,
Project Plan, Data Migration Assistant (DMA) Reports, or other Third-party
Tooling Reports

18
2.0 Design and Proof of Concept (PoC)
Partner has robust methodologies for designing the workload.
Requirement
2.1 Solution Design
The partner must provide solution designs showing a consistent approach that addresses
customer requirements captured from the assessment phase. Solution design must show, where
applicable, the below customer requirements based on the assessment. Where the approach is
not applicable, the partner must state why not.
User Roles: User roles required to deploy the AI solution (developer, AI Engineers, data scientists,
DevOps, AIOps etc.) and establish role-based access
Data Source: All data sources and file types to be ingested
Ingestion Engine: The use of a data ingestion engine to extract, transform, load, and clean data.
Ingestion engines includes but are not limited to native products such as Azure Data Factory,
Informatica, Data Stage, and Azure Databricks
Data Storage: The storage type for the ingested data. Data storage can include but is not limited
to native products such as Azure Blob, Azure Data Lake, Azure Data Warehouse, Azure Synapse
Encryption Method: Data encryption approach. Data encryption methodology can include but
is not limited to Transparent Data Encryption (TDE), masking and Azure Key Vault
Data preparation: Can include but is not limited to: Azure Synapse Analytics, Azure Databricks,
Azure MLCompute
Microsoft’s RAI Standard: Read and review the RAI Standard V2
Impact Assessment: Partner will conduct an impact assessment for any AI system being
created using the Impact Assessment Template and the Responsible AI Impact Assessment
Guide.
Security: Appropriate service and index level security implementation (I.e., VNETs, private endpoints,
RBAC, security filtering, etc.)
Sizing and performance: Identify where design is meeting the requirements and considerations
identified in the assess phase
Monitoring: Performance monitoring and diagnostics
Cost control: Identify where design can extract financial insights from available data
Model / Algorithm / AI Service Selection: Design incorporates AI model, algorithm, service
selection including training method
Inferencing / Deployment: Approach and design (ACI AKS quotas, limits, managed endpoints etc.)
The AI considerations are incorporated into the design e.g., Transparency, explainability, bias,
disparity etc. Automation and Dev Ops: Design includes DevOps, ML Ops, CI/CD tools and
processes as required to meet the requirements
AI Architecture: Solution architecture highlights best practices and guidance for the selected
AI services In addition, the partner must demonstrate design capability across at least one (1)
of the listed below practice specialties:

• Machine Learning Lifecycle(competency in building custom machine


learning). Design must show:
 ML Platform design including end to end MLOps process/ pipelines for scale
 ML scoring requirements and metrics
 Versioning and tracking, ML audit, governance, and policies
OR
• AI-Powered Apps (competency in applying cognitive services, (Azure Open AI, Azure
Vision, Azure Speech, Azure Language, Azure Decision), cognitive search, or
customizing existing algorithms in cloud-native apps. Design must show:
 Cognitive services transactions, pricing and cost considerations are factored
into the design
 AI Interface and interaction design
 Container deployment architecture
 Cloud native app design and development
 Cognitive search: Data indexing and data tuning for search relevancy and
performance with optional vector search
 Cognitive search: Search pipeline

19
Required evidence:
The partner must provide relevant solution design documents that address the points above, from at
least three (3) unique customers with Azure AI projects completed within the past twelve (12)
months.

Acceptable Documentation: Partner must show design documents, which includes at minimum two
(2) of the following:
 Project Plan
 Functional Specifications
 Architectural Diagram
 Automated Tooling Reports
 Physical and Logical diagrams
 The partner acknowledgement for review of the RAI Standard V2
as read
 A completed Customer Impact Assessment using the Impact Assessment
Template

2.2 Azure Well Architected Review of Workloads


The partner must demonstrate usage of the Azure Well-Architected Review on Azure AI
workloads. The Azure Well-Architected Review is designed to help partners evaluate your
customers' workloads against the latest set of industry best practices. It provides actionable
guidance to design and improve your customers' workloads.

The Review can be used to evaluate each workload against the pillars of the Azure Well-Architected
Framework that matter to that workload.

Required evidence:
Note the mandatory review for the operational excellence pillar. The AI Azure specialization
checklist has a requirement for the Well Architected Review for Operational Excellence Pillar,
which must be conducted upon Review and Release for Operations completion, as specified in
control 4.1.
The partner must provide exported results from the completed Microsoft Azure Well Architected
Review using the assessments in Well-Architected Review, conducted in the last twelve (12)
months, for three (3) workloads using Azure AI services indicating the customer’s name.

The three (3) workloads can come from one (1) or more customers.

20
2.3 Proof of Concept or Pilot
Partner must provide evidence of a completed proof of concept (PoC) or pilot project. The
PoC or pilot project must validate the design decisions, review, and adjust the design as
appropriate before production rollout.

PoC or pilot project must document the purpose, customer pain points, project success criteria,
intended benefits of the project, and results for at least one (1) of the following Azure services:

1. Azure Cognitive Services (Azure Open AI, Azure Vision, Azure Speech, Azure Language, Azure
Decision)
2. Azure Applied AI Services
3. Azure Machine Learning
4. Azure Cognitive Search

Required evidence:
Partner must provide relevant documentation for one (1) customer with a completed proof of
concept (PoC) or pilot project within the past twelve (12) months that includes at least one (1)
of the four Azure AI services listed above in 2.3.

Accepted Documentation: PoC/Pilot architecture diagrams; reference architectural design


blueprints; test plans and results; implementation documentation; other PoC documents; or a
monitoring tool report.

3.0 Deployment
Partner has robust methodologies for deploying the workload.
Requirement
3.1 Deployment
Partner must provide evidence of the partner’s capability to implement AI solutions deployed in
production environments, based on customer-approved designs. The deployment must include
at least one (1) of the following Azure products:
1. Azure Cognitive Services
2. Azure Applied AI Services
3. Azure Machine Learning
4. Azure Cognitive Search

Required evidence:
Partner must provide documentation for any of the above AI services for three (3) unique
customers with completed projects within the past twelve (12) months. Documentation
provided for each customer must cover the entire sequence of the project (from design
to production deployment) and must include at least two (2) of the following items:
• Signed SOWs for all projects
• Solution Design Documents for all projects
• Project Plan and Migration/deployment sequence
• Architecture Diagrams
• High Level Design (HLD) and Low-Level Design (LLD)
• As-built Documentation

21
4.0 Review and Release for Operations
Partner has robust methodologies for transitioning the workload.
Requirement
4.1 Service Validation and Testing
Partner must validate the deployment, including:
• Demonstrate the process and approach for testing and evaluating the
performance of all solutions against end user expectations and Azure best
practices.
o Demonstrate assessment where applicable against the Cloud Adoption
Framework best practices and the disciplines for Well Architected
Framework Operational Excellence Pillar:
 Application design
 Monitoring
 Application performance management
 Code deployment
 Infrastructure provisioning
 Testing

The partner must demonstrate the process and approach for evaluating and improving
architectural best practices to remediate issues with workloads that do not meet
performance or cost expectations.

Required evidence:
Documentation of testing and performance validation that addresses the above points for the
three (3) unique customers with projects completed in the last twelve (12) months. The
documentation must indicate that the implemented solution meets customer expectations with a
sign-off from the customer. These projects can be the same as the projects evidenced earlier in
Control 3.0, Deployments.

Exported results from a completed Microsoft Well Architected Review (using the Operational
Excellence pillar) assessments in Well-Architected Review conducted post-deployment, indicating
the customer’s name is the acceptable evidence for this section. The Well-Architected review must
have been for a project completed in the last twelve (12) months.

4.2 Post-deployment Documentation


Partner must provide documentation post-deployment to ensure customers are successful in using the
new service in Azure.
• Demonstrate how the partner documents, decisions, architectural
designs, and procedures were implemented.
• Demonstrate Standard Operating Procedures for business-as-usual
operations team which describe ‘how-to’ scenarios.

Required evidence:
Documentation showing the above points, for three (3) unique customers with Azure AI
projects completed within the last twelve (12) months.

These projects can be the same as the projects evidenced in Control 3.0.

22
Partner FAQ
Definition of a Customer

A customer is a company which has direct contractual relationship with the partner and is not affiliated
with the partner. Each customer tenant ID (TPID) attached to the partner by DPOR, CSP or PAL is counted
as one customer. A customer can be different companies, or different departments within the same
company, represented by different TPIDs, but the projects must have different stakeholders. Internal
projects are not accepted as customer evidence for Azure specializations. The customer’s project must be
executed by the partner applying for the accreditation program. Microsoft will not accept customer
evidence from a company not included in the applying MPN PGA ID (Vorg).

Who can participate in the program?

The program is open to any members of the Microsoft Cloud Partner program who can meet the
program requirements and pass the audit.

Can a partner have more than one Azure specialization?

Yes, if you qualify, you can earn as many Azure specializations as you choose. Earning additional Azure
specializations will increase your visibility to customers in the Partner Finder tool.

Is a partner’s Azure specialization global or local?

It depends on how your company has set up your account in Partner Center. If your company has one
global account (Partner Center MPN PGA ID), your Azure specialization is assessed and awarded at the
global level. If you have set up multiple Partner Center accounts (MPN PGA ID) to represent different
divisions, countries, subsidiaries etc., only the account that earned the Azure specialization will be
awarded it.

Is there a cost to participate in the audit?

Microsoft does not charge a program fee. However, there are direct costs associated with the following
requirements:

• Solutions Partner designation

• Microsoft and third-party certifications

• Audit

In addition, there are indirect costs associated with preparation for the audit.

How much time and how many resources (people) do we need to commit to preparing to meet the
audit requirements?

The amount of time it takes to meet all requirements and pass the audit varies greatly. It depends on how
many of your current employees already have the required Azure skills, whether they have documented
customer wins, and how you document your people, technology, and processes.

23
How long do the actual audits take?

The remote audit will be either half day or a full day, based on the scope of the modules being audited.
Module A is generally four (4) hours and Module A+B is generally eight (8) hours to complete. However,
as mentioned above, significant preparation is required to be audit ready. We recommend that you read
the audit checklist thoroughly to streamline your preparation. Consider the consulting and audit
preparation overview offered by ISSI.

How much does the audit cost?

The audit fee for Module A or Module B standalone is $2,000 USD, the audit fee for Modules A+B
combined is $3,000 USD. The fee is paid to the third-party independent auditor. The audit fee must be
paid in full before the audit is completed.

How do we apply to the program?


Partners with the appropriate role and access permissions can apply. To do so, they sign into their
Partner Center account. On the left pane, select Azure under the Specialization section. Toggle to the
specialization that you wish to apply for by using the drop-down menu at the top of the page.

When should we apply to the program?

Do not apply for the program until you have met all the program requirements prior to the audit. Be sure
you have thoroughly reviewed the audit requirements and are confident you can satisfy them.

What checklist version will we be audited on?

Take note of the active dates for the audit checklist. Partners are audited against the checklist items that
are active on the date of their remote audit. The original application date has no bearing on the version of
the checklist that is used for the audit.

In which languages are the audits conducted?

These are the current audit languages:

• English

• Portuguese

• Spanish

• French

• German

• Italian

• Serbian

• Croatian

• Russian

• Hebrew

24
• Mandarin

• Japanese

• Korean

• Arabic

What languages can we provide evidence and documentation in during the audit?

ISSI will make every effort to support the partners’ specific language need. In instances where this is not
possible, the working language for the audit will be English. Partners may present evidence and
documentation in their local language. It is not required for the partner to translate their documentation
into English for the purposes of the audit.

What types of evidence should be used as examples for the audit?

The evidence should relate to the project and be signed off by the customer no earlier than 24 months
before the audit.

What is the definition of a project for audit evidence?

A project is a paid endeavor resulting in a customer solution used in production. Projects should be
complete when presented as evidence.

What is the definition of evidence for a PoC (Proof of Concept) or pilot when used for the audit?

Proof of Concepts (PoCs) and pilots by themselves do not qualify as projects Accepted evidence
documentation is specified in the checklist.

How is the audit scored?

The partner score for the audit checklist is based on the checklist controls. To pass the audit, partners
must complete all sections in each control area. They must provide adequate evidence to demonstrate the
existence, effectiveness, and efficiency of their processes, policies, procedures, and tooling against each
checklist item.

What if I meet only some of the requirements?

Because this is an Azure specialization audit for an opportunity for partners to truly differentiate your
business, we expect partners to demonstrate that they meet each of the controls by providing evidence
that satisfies all requirements.

What happens if I don’t pass the audit outright?

At the conclusion of the audit process, the auditor will issue a Final Report to the partner and notify
Microsoft of the pass or no pass result. A Pass result satisfies the audit requirement for this Azure
specialization for two (2) years. A “No Pass” result is generated when a partner fails or withdraws from
the audit. When a No Pass result is entered into Partner Center, you will see your status as “Audit Failed”

25
in your dashboard. This status will reset within one week to “Not Enrolled,” allowing you to reapply.
Contact Partner Center Support if needed.

Who conducts the audit?

The audit is conducted on behalf of Microsoft by an independent, third-party auditor, appointed by


Microsoft. The audit company is Information Security Systems International (ISSI).

Can I contact the auditor to schedule the audit before I apply or as soon as I apply?

No. The audit company, ISSI, cannot schedule your audit until it receives an official notification from
Microsoft. Microsoft will issue the notification only after you have shown that you meet all program
requirements and you have applied for an audit by selecting “schedule audit” from the Partner Center
dashboard. ISSI will reach out to you to begin the scheduling process within one (1) to two (2) business
days.

What is the difference between the audit and the consulting and audit preparation?

Consulting and the Process and Controls Overview are optional resources and are conducted by the third-
party audit company, ISSI. The purpose is to help partners prepare for the Azure specialization audit.

To ensure objectivity, audit preparation consulting is conducted by someone other than your assigned
remote auditor. You can schedule consulting engagements at any time by using your preferred
conferencing platform.

Are the consulting and audit preparation mandatory?

No, the consulting and Audit Process and Controls Overview are optional. However, it can help ensure
that you are more prepared for the audit.

What is an Azure specialization?

An Azure specialization is an extensive validation of a partner’s capability to deliver high-fidelity technical


services in a specific solution area.

How is an Azure specialization different from a Solutions Partner designation?

An Azure specialization measures specific in-depth technical capabilities in a specific workload, allowing
partners to further differentiate their organizations, demonstrate their capabilities, and build stronger
connections with customers. Azure specializations require a partner to first have an active Solutions Partner
designation aligned to the Azure specialization they are interested in earning to apply. Partners receive
benefits for both of these achievements.

26
Does a partner need a competency to earn an Azure specialization?

Yes. Azure specializations can be earned only by partners with an active, aligned Solutions Partner
designation. For example, to earn the Analytics on Microsoft Azure specialization, partners must first have
the aligned Solutions Partner designation, pass Module A, and then pass the audit workload for Module B.

What Azure specializations are available to partners?

Certain competencies have different Azure specializations available to them. For details on all available Azure
specializations, go to the Azure specializations site.

Why would a partner want to get an Azure specialization?

With an Azure specialization, partners can differentiate their capabilities to customers that are looking for
partners to help them with a business need. Partners with an Azure specialization are listed first in Partner
Finder, a Microsoft-owned, customer-facing tool. Azure specializations are also indicated on a partner’s
business profile alongside their competency status.

What are the benefits of an Azure specialization?

Partners with an Azure specialization are listed first in Partner Finder, a Microsoft-owned, customer- facing
tool. Azure specializations are also indicated on a partner’s business profile alongside their competency
status. Other benefits also apply, see https://aka.ms/partnerincentives for more information.

How does a partner earn an Azure specialization?

Each Azure specialization has a set of requirements that a partner must meet. The criteria depend on the
Azure specialization the partner is seeking, but they can include performance requirements, exams,
customer evidence, and third-party certification, among others. For detailed criteria for individual Azure
specializations, go to your Partner Center dashboard. Azure specializations are not available in PMC.

Is there a cost associated with attaining an Azure specialization?

Microsoft does not charge a program fee. However, there are direct costs associated with the following
requirements:
• An active Solutions partner designation
• Microsoft certifications
• The audit, optional ISSI consulting and audit preparation, and third-party certifications

In addition, there are indirect costs associated with preparation for the audit, including audit preparation
hours.

How long do partners keep their Azure specialization?

Your Azure specialization will remain in place for one (1) year, but it requires that you maintain an active
aligned Solutions Partner designation defined in the Azure specialization requirements. If you do not
maintain your Solutions Partner designation, you will lose your Azure specialization status. On your
renewal date, you will need to meet the then-current requirements.

27
When and how do partners renew the Azure specialization?

Partners renew their Azure specialization on their anniversary date. See the specific
requirements in Partner Center. Partners must also maintain an active, aligned Solutions
Partner designation.

Do partners need to requalify for the Azure specialization after a specific period of time?

Yes. Partners must meet the specialization requirements each year. The renewal process is triggered
based on the anniversary date of your current Azure specialization. See the specific requirements
and Anniversary date in Partner Center.

Year 1: (First anniversary of achieved specialization): To renew the specialization, you'll need to
meet telemetry-based requirements (such as eligibility, performance, certifications, offer publishing)
only. The telemetry-based requirements are valid for one year and revalidated annually. Telemetry
requirements will be reviewed for all anniversary dates beginning February 2023. Renewing your
specialization during the first renewal cycle doesn't require any action outside of monitoring that
your organization meets the requirements. Should your organization meet the telemetry
requirements, you will be auto enrolled upon your renewal window opening.

Year 2: (Second anniversary of achieved specialization): To renew the specialization, you must meet
the telemetry-based requirements and complete the manually validated requirements (such as an
audit or providing customer references, depending on the specialization). The third-party audit to
renew the workload specialization is valid for two years and revalidated every other year. This will
start with anniversary dates beginning February 2024.

Year 3+: (Following years): Utilize the same processes with telemetry requirements validated
annually and telemetry + manually validated requirements every other year.

What happens to the Azure specialization if a partner does not renew their associated Solutions
Partner designation?

To maintain an Azure specialization, partners must keep their active, aligned Solutions Partner
designation status at all times.

How will my customer know whether my company has an Azure specialization?

Your Azure specialization will be listed on your Business Profile.

What can partners tell customers about Azure specializations?

An Azure specialization is a customer-facing label on your Business Profile. There is a badge


associated with it. You can tell your customers which Azure specializations you have earned.
They can validate by reviewing your Business Profile in the Partner Finder tool. Partners can
also create a partner logo, certified letter, or award. To learn more link to

Logo Builder - Partner Center | Microsoft Learn

What if my company has an endorsement now?

As Azure specializations go live, they replace endorsements on the customer-facing profile. Each
Azure specialization has published requirements for partners to meet to earn them.

28
Can a company have both an endorsement and an Azure specialization on its profile?

No. As Azure specializations go live, they replace endorsements on the customer-facing Partner Profile.

Does a partner get a badge to use externally in their marketing to differentiate their Azure
specialization?

Yes, Azure specializations now have a badge, We are providing a customer-facing badge to display on
your business profile in your Microsoft AppSource partner gallery, and on your marketing assets and
resources to promote your expertise. You can download your badge from Logo Builder in Partner Center
https://partner.microsoft.com/dashboard/mpn/membership/benefits/logobuilder More information on Logo
Builder can be found here: https://docs.microsoft.com/en-us/partner-center/mpn-logo-builder

Other questions on the program?

If you have questions that we have not answered in this document, please go to Partner Center
support to create a ticket with our Frontline team.

29

You might also like