Training Machine Learning Models With Snowpark Python - Snowflake Documentation
Training Machine Learning Models With Snowpark Python - Snowflake Documentation
Snowpark-Optimized Warehouses
Training machine learning (ML) models can sometimes be very resource intensive.
Snowpark-optimized warehouses are a type of Snowflake virtual warehouse that
can be used for workloads that require a large amount of memory and compute
resources. For example, you can use them to train an ML model using custom code
on a single node.
These optimized warehouses can also benefit some UDF and UDTF scenarios.
For more information about how to create a Snowpark-optimized warehouse, see
Snowpark-optimized warehouses.
Using Snowpark Python Stored Procedures for ML
Training
Snowpark Python stored procedures can be used to run custom code using a
Snowflake warehouse. Snowpark-optimized warehouses make it possible to use
Snowpark stored procedures to run single-node ML training workloads directly in
Snowflake.
A Python stored procedure can run nested queries, using the Snowpark API for
Python, to load and transform the dataset, which is then loaded into the stored
procedure memory to perform pre-processing and ML training. The trained model
can be uploaded into a Snowflake stage, and can be used to create UDFs to
perform inference.
https://docs.snowflake.com/en/developer-guide/snowpark/python/python-snowpark-training-ml 1/1