Scribd Logo
Upload

Welcome to Scribd!

  • 40 views

    7.stages in Snowflake

    Uploaded by

    Rick V
    Stages in Snowflake are locations that specify where data files are stored so they can be loaded into tables. There are two types of stages: external stages which reference cloud storage locations, and internal stages which can be user stages, table stages, or named internal stages stored within Snowflake. Data is loaded into tables by copying from stages, with the appropriate file format specified.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd

    7.stages in Snowflake

    Uploaded by

    Rick V
    40 views15 pages
    Stages in Snowflake are locations that specify where data files are stored so they can be loaded into tables. There are two types of stages: external stages which reference cloud storage locations, and internal stages which can be user stages, table stages, or named internal stages stored within Snowflake. Data is loaded into tables by copying from stages, with the appropriate file format specified.

    Original Description:

    booo'd

    Original Title

    7.Stages in Snowflake (2)

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Stages in Snowflake are locations that specify where data files are stored so they can be loaded into tables. There are two types of stages: external stages which reference cloud storage locations, and internal stages which can be user stages, table stages, or named internal stages stored within Snowflake. Data is loaded into tables by copying from stages, with the appropriate file format specified.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    40 views15 pages

    7.stages in Snowflake

    Uploaded by

    Rick V
    Stages in Snowflake are locations that specify where data files are stored so they can be loaded into tables. There are two types of stages: external stages which reference cloud storage locations, and internal stages which can be user stages, table stages, or named internal stages stored within Snowflake. Data is loaded into tables by copying from stages, with the appropriate file format specified.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    of 15

    Stages in Snowflake

    by
    Veerendra
    Agenda
    • What is a Stage?
    • Stage Types
    • External Stages
    • Internal Stages
    • Data load from Stages
    What is a Stage?
    • A stage specifies where data files are stored (i.e. “staged”) so
    that the data in the files can be loaded into a table.

    • Stage is a location of files, that can be internal or external to


    snowflake
    Stage Types
    1. External Stages
    2. Internal Stages
    1. User Internal Stage
    2. Table Internal Stage
    3. Named Internal Stage
    External Stages
    • An external stage is the external cloud storage location where data
    files are stored.
    • Loading data from any of the following cloud storage services is
    supported regardless of the cloud platform that hosts your Snowflake
    account:
    • Amazon S3
    • Google Cloud Storage
    • Microsoft Azure
    External Stages
    • An external stage is a database object created in a schema.
    • This object stores the URL to files in cloud storage.
    • Also stores the settings used to access the cloud storage account
    (Storage Integration Object).
    • Create stages using the CREATE STAGE command.

    CREATE OR REPLACE STAGE MYDB.external_stages.sample_stage


    url='s3://bucketsnowflakes3';
    Internal Stages
    3 Types of Internal Stages:

    1. User Stage
    2. Table Stage
    3. Named Internal Stage
    User Stage (@~)
    • A user stage is allocated to each user for storing files.
    • To store files that are staged and managed by a single user but can be
    loaded into multiple tables.
    • User stages cannot be altered or dropped.
    • This option is not appropriate if multiple users require access to the
    files.
    Table Stage (@%)
    • A table stage is available for each table created in Snowflake.
    • Table stages have the same name as the table.
    e.g. a table named mytable has a stage referenced as @%mytable
    • To store files that are staged and managed by one or more users but
    only loaded into a single table.
    • Table stages cannot be altered or dropped.
    • Note that a table stage is not a separate database object, rather it is
    an implicit stage tied to the table itself.
    Named Internal Stage (@)
    • A named internal stage is a database object created in a schema
    • To store files that are staged and managed by one or more users and
    loaded into one or more tables.
    • Create stages using the CREATE STAGE command (similar to external
    stages)

    CREATE OR REPLACE STAGE MYDB.internal_stages.sample_stage


    Staging Data Files from a Local File System

    Linux or macOS:
    put file:///data/data.csv @~/staged;
    put file:///data/data.csv @%mytable; Listing Files:
    put file:///data/data.csv @my_stage; list @~;
    list @%mytable;
    list @my_stage;
    Windows:
    put file://c:\data\data.csv @~/staged;
    put file://c:\data\data.csv @%mytable;
    put file://c:\data\data.csv @my_stage;
    Copying data from Internal stage
    User Stage:
    To Load all files prefixed with staged in your user stage,
    copy into mytable from @~/staged
    file_format = (type = csv field_delimiter = '|' skip_header = 1);

    Table Stage:
    To load all files in the stage for the customer table,
    copy into mytable from @%customer
    file_format = (format_name = my_csv_format);
    Copying data from Internal stage

    Named Stage:
    To load all files from the my_stage named stage,
    copy into mytable from @my_stage;

    Note that a file format does not need to be specified because it is


    included in the stage definition.
    Thank You

    You might also like