MDE - Release Notes
MDE - Release Notes
Glossary of terms
documentation/pdf/MDE - Glossary of Terms.pdf
Release 1.2.0
Applicable Versions
● MDE 1.2.0-120
● MC 2.6
What is New?
● Introduced versioning control tables and labels to the solution storage elements such as BigQuery and
CloudSQL. This enables MDE to check the compatibility of the deployment and avoid unexpected problems.
● Upgradeability scripts, simplifying the transformations of required schema, configuration and data series
changes changes as well as re-deployment of upgraded compute artifacts like dataflow jobs, or GKE workloads
● Introduced the ability to export and import configurations from MDE config-manager components. The exported
configuration is stored into a GCS bucket which can be used to import configuration to another environment, if
both environments are on the same level of 1.2.0.
● This release uses BigQuery JSON columns natively, and it provides an upgrade script that enables this feature by
default on existing deployments. For new deployments, the BigQuery JSON feature is enabled by default. You
will need to run the upgrade script before deploying 1.2.0 release
● Multiple stability improvements and better troubleshooting logs/tools
● Introduced an operational dashboard for error reporting and performance monitoring
● Introduced the ability to dynamically subscribe to tag streams via Pub/Sub. You can enable/disable the
subscription by adding a new transformer on the type level, and it will automatically send the tags belonging to
that type to a pub/sub. This enable further extensibility to MDE by subscribing to a particular list of tags to do
further processing
● This release also includes alpha features for enabling anomaly detection, and it is enabled in a closed preview
mode through the solution team. Please contact the manufacturing solutions team if you have a business case
and would like to enable this feature.
Release 1.1.2
Applicable Versions
● MDE 1.1.2-110
● MC 2.5
What is New?
● Introduced the ability for the config-manager and federation-api to connect to a BigQuery instance outside the
project where they are deployed. You will need to specify the extra attribute sfp_bigquery_project_id to the project
ID of BigQuery.
● Simplified the load-balancer provisioning by using TCP/UDP internal load-balancer instead of proxy-based for all of the
exposed services. This simplifies the network subnet requirements and firewall rules to enable the proxy-based
load-balancers to work.
Release 1.1.0
What is New?
● New Features
○ Metadata management UI: Fully supported integration with Manufacturing Connect (cloud app)
○ Metadata Learning Mode: Automatically infers metadata buckets and schemas based on data from the edge
○ Metadata Domain Files: More control over the metadata validation
○ Observability & Error Reporting using both Stackdriver and BigQuery operational table for improved
observability and error reporting
○ Enabled delete operation via API for Payloads, Parsers, and Domain Files
○ Introducing two deployment size options:
■ Small deployment: Supports up to 1k msg/s with single Dataflow workers jobs. Suitable for proof of
concept environments and small deployment sizes.
■ Medium deployment: Supports up to 50k msg/s based on multiple Dataflow workers
■ Large deployment option is available as preview on request (with up to 100k msg/s validated)
● General Improvements
○ Optimized deployment size with a 66% reduction vs. previous version
○ Improved performance and efficiency utilizing the same resource footprint (tested with up to 100k msg/s)
○ Various stability improvements and bug fixes
○ Various additional security measures implemented
○ Various cost optimization measures (e.g., reduced logging volume outside debug mode, filters on PubSub to
optimize DataFlow processing)