Snowpipe : Snowflake's Continuous data ingestion service using AWS stage
Sanjay Kattimani
#Snowflake, #snowflakecomputing, #SnowPipe Video navigates through all the setup to create a data ingestion pipeline to snowflake using AWS S3 as a staging area. Architecture, various tips and tricks are discussed along with a talend etl job that creates sample data.
00:00 Introduction 00:45 Whats covered in this video? 01:30 What is a SnowPipe 02:00 SnowPipe documentation on snowflake site 04:40 Talend job to create our data files 06:05 Amazon web services related configurations to facilitate data ingestion 09:40 Snowflake setup to create data ingestion (stage and pipe creation) 12:40 SQS & notification channel setup 16:04 Considers to optimize your ingestion. 17:00 SnowPipe billing 18:00 Conclusion
Join Snowflake users WhatsApp group : https://bit.ly/snowflakegroup
Follow me on Twitter : http://twitter.com/kattimani
Connect with me on LinkedIn : http://linkedin.com/in/sanjaykattimani ... https://www.youtube.com/watch?v=3qS8INSRv4s
80751191 Bytes