HCS Container Migration Service Introduction
HCS Container Migration Service Introduction
Name : Bensen
Time : 2024-12-13
1
Contents
1 Background
2 Service Overview
4 Service Highlights
5 Success Story
2
Enterprise Digital Transformation Rapidly Entering the Cloud Native Phase
• Management of scattered physical servers • Centralized cloud resource pool • Unified cloud native infrastructure
• Software and hardware isolation • Software migration to the cloud • Cloud native software architecture
• Device-centric • Resource-centric • Application-centric
Operations Operations Cloud Agile New Microservice Middleware AI/big data Edge/IoT
support CRM/ERP
Core service
… support CRM/ERP O&M development
Core service
service …
…
system system application application application application
system system system system system
Enterprise
Enterprise service Cloud-based Lightweight service Cloud middleware
Database
bus
middleware
database framework platform
Cloud native platform
platform
3
Features and Values of Containers: Lightweight, Fast, and Flexible
Containers use a lightweight OS virtualization solution, which A new form of software packaging and delivery together with its
virtualizes resources based on the OS to provide resources of finer storage, distribution, and running systems
granularity.
Containers can run on VMs and physical machines.
RPM
package
Container
Application images
configuration Application
OS server
Deliverables after
Traditional deliverables
containerization
⚫ Lightweight: Shared kernel and fine-grained resource isolation (lower enterprise costs)
⚫ Fast: Quick start and stop in seconds (applicable to agile scaling scenarios)
⚫ Flexible: Environment-independent standard delivery and deployment specifications
(higher delivery efficiency)
4
Overall Architecture of Huawei Cloud Stack Cloud Native Infrastructure Solution
Application ecosystem
Hybrid innovative applications
Standard, open, and complete cloud native application ecosystem
Industry standard: Cloud native applications are fully compatible with Helm.
Hybrid innovation: Applications can be combined based on service innovation
Stateless Stateful Compute-intensive requirements to develop new applications.
Container services
Multi-cloud management platform
Ubiquitous Cloud Native Service (UCS) Cloud native OS with consistent experience across regions, DCs, edge, and
clouds
Edge-cloud synergy UCS: cross-cloud, cross-region cluster management, global and unified
SoftWare Repository Application Service application management, which address elasticity and scheduling challenges
Intelligent
for Container (SWR) Mesh (ASM) during peak hours.
EdgeFabric (IEF)
ASM: application non-intrusion, multi-language, and enterprise-ready service
Cloud Container Engine governance, 50% higher performance than open-source solutions.
(CCE) | CCE Turbo Volcano: AI and big data batch computing is 50% more cost-effective.
Storage volume
Storage
Faster computing
➢ Next-gen compute instance C7e
CCE Turbo
➢ Overall server performance up 30%
Container network Container storage Intelligent scheduling Cloud-edge synergy
Network acceleration
➢ Two network layers flattened into one for passthrough
OS: Euler
networking
Huawei Cloud Stack infrastructure ➢ Zero network loss and 20% decrease in delay
1 Background
2 Service Overview
4 Service Highlights
5 Success Story
10
Service Trends
With the deepening of digital intelligence, the iteration of cloud products is accelerating. Huawei container products are becoming more beneficial,
and customers traditional on-premises containers show more and more disadvantages. Customers impose higher and higher requirements for
container migration.
Scenario 1 Scenario 2
12
Challenges Created by Customer Requirements
Impacts on services
• Can the migration be performed without service interruptions? What are the
resulting impacts and risks? What is the minimum downtime window?
Impacts on
services Migration costs
Migration • How can we calculate how much migration will cost and how long it will take?
Is it necessary to invest extra devices for environment verification and
costs testing?
Migration efficiency
Migration
efficiency • How efficient is the migration? What factors affect efficiency? Is batch
migration feasible? Does the migration need to be planned?
Data security
Data security
• How is the data consistency after resources inside and outside a cluster
are migrated? How can we avoid data loss? How can we verify and roll
back upgrades, if needed?
13
Service Scope
Huawei Cloud Stack Container Migration Service Service design
⚫ Huawei Cloud Stack Container
Service survey Solution Migration Testing and Migration Service: supports end-to-end
design implementation verification enterprise service container migration
from requirement survey, solution design,
and migration implementation, to testing
and verification.
Scenario 1 Scenario 2
Note: On-premises clusters can be migrated regardless of if they are on cloud or not, as
long as the migration conditions are met.
14
Service Benefits/Customer Benefits
For Customers:
• Standard service processes ensure a full migration can be completed.
Verification • Optional simulations to test if verification requirements can be met in
Acceptance
special migration scenarios.
• Standard services ensure secure and reliable migration operations.
Implementation
• Migration tools greatly increase migration efficiency and reduce migration
costs.
Maintenance • Evaluation effectively identifies risks and helps keep service impacts under
control when there are emergencies.
• The validity of a migration is reviewed during verification, with rollbacks
(Optional) supported at any time.
Simulation Tools
Evaluation
For services:
Solution
design • Service impacts are reduced and continuity improved.
• The migration is more efficient and less expensive.
• Customers get a solid foundation, a major step forward, for cloud native
transformation.
15
Contents
1 Background
2 Service Overview
4 Service Highlights
5 Success Story
16
Migration to Huawei Cloud Stack
High data risk Capex is a large one-off investment Only for infrastructure Limited expert resource
Pain Points of Cannot scale down services Difficulty in using new Low reliability and risk of load shading
Failure to meet regulatory requirements
Hosting
High cost and low utilization of DR High maintenance costs technologies Unstable SLA
Evaluation and Survey Planning and Design Migration Implementation Migration Acceptance
5 On cloud 10 Implementation 14
1 Service information 2 Monitoring
solution design discussion
Resource list review
collection
7 12 Data 16
4 Function and Handover
Cloud migration performance verification synchronization
Policy evaluation
Successful
Target Customers Key Enterprises NA Government Big Banks OP or Hosting to Cloud Cases
17
Service SOW (Responsibility Matrix)
R stands for Responsibility and S for Support.
Custom
No. Service Process Service Content Huawei/Telecom
er
Survey the customer's live network environment, service resource usage, migration environment,
1 Service/Resource survey S R
compute resources, storage resources, network resources, and more.
Evaluate feasibility based on the existing environment, service classification, and destination end
2 Technical feasibility evaluation R S
compatibility.
3 Risk evaluation Evaluate any post-migration risks, such as data loss or system startup failures. R S
Evaluate the source end environment, destination end environment, and migration network
4 Migration duration evaluation R S
environment, and perform tests if conditions permit.
Resource planning for the target
5 Plan cloud resources for the target environment to maximize resource utilization. R S
cluster
6 Migration restrictions Clarify some restrictions, such as ports used by the migration tools. R S
7 Migration solution design Formulate an executable migration solution based on the customer's live network environment. R S
8 Solution review The solution is reviewed by second-line and third-line experts to identify problems. R S
9 Solution verification Set up an environment to verify the feasibility of the solution. R S
Cloud Container Engine (CCE)
10 Create a migration environment. R S
cluster creation
11 Migration tool installation Deploy required migration tools. R S
12 Data/Application migration Migrate data and applications. R S
13 Resource updates and adaptation After data and applications are migrated, reallocate resources in the target environment. R S
Use various services to access the system and check the data integrity after the migration is
14 Service testing S R
complete.
15 Traffic switchover Perform a service cutover from the source end to the destination end. S R
Once the traffic has been switched, customer services should be able to access the target end. After
16 Taking source resources offline S R
a period of time, take the source end offline.
17 Project acceptance The source resources are completely migrated to the target end, and services are accessible. S R
18
Migration Objects
The Container Migration Service migrates container cluster resources, including data, services, and configurations. All the
resources inside and outside clusters are included. This service focuses on resource migration within clusters. Migration of
resources outside a cluster needs other migration service products and capabilities. For example, when migrating non-
containerized databases or object storage, database migration and storage migration services are required, respectively.
Resource
Migration Object Remarks
Category
Both hostPath and Local volumes are local storage volumes. However, Restic, which is integrated into
PersistentVolumes (PVs) mounted to a container Velero, cannot back up hostPath PVs. It only supports the Local type. So, you need to replace the storage
volumes of the hostPath type with the Local type in the source cluster.
Resources Non-containerized databases (other migration They can be migrated to Relational Database Service (RDS). After the migration is complete, you need to
outside a cluster services needed) reconfigure the databases for applications in the target cluster.
The data can be migrated to Object Storage Service (OBS). After the migration is complete, you need to
Object storage (other migration services needed)
reconfigure the object storage for applications in the target cluster.
19
Migration Procedure
There are six steps in container migration, including creating a target cluster, migrating data, migrating applications, verifying
services, switching traffic, and taking the source cluster offline.
Start
Target container cluster creation
⚫ Target cluster creation and resource configuration on Huawei Cloud containers.
Create a target ⚫ It is recommended that the performance configurations on the target cluster are
container cluster. the same as that on the source cluster.
Data migration
Migrate data. ⚫ Database, storage, and image migration
Application migration
Migrate applications. ⚫ Kubernetes resource objects and persistent data are migrated using
Migration4CCE and resource updates.
20
Migration Precautions
DNS
6. Perform additional tasks:
Precautions
• Verify services
• Switch over traffic
• Take the source cluster offline
• The Migration4CCE, a tool from Huawei based on Velero, is recommended.
Load balancer Elastic Load Balance (ELB) • The resources in the velero and kube-system namespaces should not be
migrated. The resources in kube-system are related to system services, so
they do not need to be backed up. Those in velero are related to the deployed
Container cluster
IDC on-premises cluster A 1. Plan resources for velero service, so no backup is required for them either.
3. Install the target cluster. • Restic integration of the Migration4CCE requires Kubernetes (the
Service Migration4CCE. Service MountPropagation function). This function is enabled by default in Kubernetes
5. Update resources 1.10.0 and later versions.
accordingly.
• When there are same resources in the source and target clusters,
Deployment Deployment
StatefulSet Application Application Migration4CCE does not restore resources by default. Ensure the target cluster
StatefulSet
… backup Backup files restoration does not have the same resources as the source cluster.
…
• About resource updates and adaptation:
➢ Access service: When migrating containers developed by different
4. Migrate resources
Pod Pod Pod within a cluster. Pod Pod Pod vendors, the ways these containers' load balancing services are made
available need to be updated accordingly because the load balancing
services vary.
➢ StorageClass: The backend storage infrastructure before and after the
Resources outside a cluster Huawei Cloud Stack cloud services migration is different, so the StorageClass needs to be updated
accordingly.
2. Migrate resources
outside a cluster.
➢ Database: After databases are migrated to the cloud, applications need to
Data
MySQL file Image RDS OBS SWR be adapted.
21
Emergency Plan
After the migration testing is complete and traffic is switched to the target cluster, if a fault occurs during service verification and a rollback
is required, adjust the DNS configuration for a quick traffic switch to the source cluster.
Migration Rollback
DNS DNS DNS
Load balancer
ELB Load balancer ELB
Success
Source cluster A Container cluster A
Fault
Container cluster A Source cluster A
22
Migration Principle: Image Migration
23
Migration Principle: Cluster Resource Migration
⚫ Migration4CCE can migrate resources within a cluster and uses object storage as the backup storage.
⚫ Backup: The Kubernetes API server is invoked to create a backup object using kubectl, so that the resource objects and persistent volume data of the source
cluster can be packaged and uploaded to Huawei Cloud Stack OBS. All cluster resources are stored in JSON files.
⚫ Restoration: The Kubernetes API server is invoked to create a restore object using kubectl, so that resources can be downloaded from the cloud object
storage and then restored based on the JSON files.
24
Migration Principle: Migration4CCE vs. Velero
Velero Migration4CCE
25
Key Steps Description
High data risk Capex is a large one-off investment Only for infrastructure Limited expert resource
Pain Points of Cannot scale down services Difficulty in using new Low reliability and risk of load shading
Failure to meet regulatory requirements
Hosting
High cost and low utilization of DR High maintenance costs technologies Unstable SLA
Evaluation and Survey Planning and Design Migration Implementation Migration Acceptance
5 On cloud 10 Implementation 14
1 Service information 2 Monitoring
solution design discussion
Resource list review
collection
7 12 Data 16
4 Function and Handover
Cloud migration performance verification synchronization
Policy evaluation
Successful
Target Customers Key Enterprises NA Government Big Banks OP or Hosting to Cloud Cases
26
Key Steps: Service Survey and Resource Survey Huawei Cloud Stack Container Migration Service Information Survey Form.xlsx
Information about the application system deployment architecture is collected, including how it
Service survey: connects with other systems or services and when users primarily use it. This will help with
evaluating migration and designing migration solutions.
Resource survey:
Information about the cluster system, the image repository, container storage, container network, and how they connect to other systems or
services is collected. This will help with evaluating migration and designing migration solutions.
27
Key Steps: Risk Evaluation
Research and analyse the services in the source cluster to identify migration risks in different scenarios.
Scenario 2 Scenario 3
Scenario 1
Zero risks
Zero risks Controllable
Stateless Stateless Stateless Stateless
Stateless Stateless risks
application A application B application A application B
application A application B
PV PV PV PV
configuration files log files application data application data
28
Key Steps: Migration Duration Evaluation
When estimating how long a migration will take, include the time required for survey and evaluation, solution design,
migration implementation, testing and verification, and emergency recovery.
3 Resource migration
04 03 Migration of resources outside a cluster, such as database migration, storage migration, and image
migration, can be done in full in real time using specific migration tools. When migrating resources
Resource migration within a cluster, the storage volume backup and restoration can be done by Restic, which is
Testing and verification: duration: assessed integrated into Migration4CCE. The following assessment model can be used to initially estimate
assessed based on based on services the resource migration duration: (Considering extra overheads such as network and I/O, it is
service characteristics scenarios involving recommended to reserve 50% buffer.)
Rollback duration: persistent data volumes,
within 30 minutes and bandwidth Persistent data volume
Resource migration duration = X (1 + 50%)
Inband rate
29
Key Steps: Migration Restrictions
Container migration is done using Migration4CCE, which has some restrictions. Specifically, it cannot migrate hostPath local storage
volumes, only Local type volumes. Since both hostPath and Local storage volumes are considered local storage, hostPath volumes in
the source cluster must be replaced with Local volumes beforehand. To do this, follow these steps:
1 Create a StorageClass YAML file for creating a local 2 Change the hostPath field to the local field, specify the original local 3 Verify the results.
volume as follows: disk path of the host machine, and add the nodeAffinity field.
30
Contents
1 Background
2 Service Overview
4 Service Highlights
5 Success Story
31
Service Highlights
• Onsite support from experts with actual • Complete end-to-end technical solutions
reconstruction experience • Development guided by Huawei senior software
• Advanced Huawei Cloud Stack cloud native engineers
transformation methodology • Thoughtful resource planning and deployment for
maximum benefits at minimum costs
World's top cloud native expert teams, founding member of CNCF, No.1 Kubernetes code
contributor in Asia, and the only Istio steering committee member from Asia
32
Competitiveness
⚫ Resources in a cluster can be migrated using software tools. The more resources there are in a cluster, the more benefits there are to a tool-
based migration. If the resources in a cluster are limited, manual deployment is recommended for service migration.
⚫ The tools support flexible migration modes, automatic organization synchronization, and node and resource updates, which are more
convenient and efficient than manual migration.
33
Contents
1 Background
2 Service Overview
4 Service Highlights
5 Success Story
34
Success Story: An E-Commerce Platform
Background: For faster service rollout and iteration during flash sales, an e-commerce platform migrated and integrated its on-premises
Kubernetes container platform to improve the system's ability to handle flash sales during promotions. Services such as payment processing and
risk control were deployed on containers in a unified way. This reduced the network latency and the virtualization overhead.
Customer pain points
⚫ O&M: Containers and VM application environments need
Current Architecture
Container (Kubernetes) Container architecture upgrade ⚫ Enhanced O&M and R&D efficiency: A unified service
deployment environment helps CI/CD automation,
Pod Pod Pod Pod Pod Pod increasing efficiency by 50% and improving online
scenario response capabilities.
Foreground Customer service Central console E-mall Payment Risk control
⚫ More stable services: Containers can be scaled in
seconds. This helps handle traffic bursts. Exception
Sidecar Sidecar Sidecar Sidecar Sidecar Sidecar warning and proactive recovery ensure stable services.
⚫ Non-intrusive service governance: Language-agnostic,
non-intrusive service governance supports management
of applications in non-Java languages, such as PHP, and
ASM (lstio) enables service governance at scale to handle
Service discovery Service governance Certificate management Grayscale release exponential service growth.
Policy delivery Link collection Security verification Access monitoring
35
Thank you. Bring digital to every person, home, and
organization for a fully connected,
intelligent world.
36
36