The Data Planet - Vol. 11

October 29, 2021
October 29, 2021

Whether it’s recent news or just new to you, The Data Planet serves up fascinating insights and resources ABOUT the Data analytics and BI WORLD EVERY MONTH.

Our snack-size summaries skip straight to the point.

This edition of the Data Planet includes:

  • Data-driven Software: Towards the Future of Programming in Data Science
  • Get the Scoop on New Snowflake Features Released this Summer
  • Welcome to Snowpark: New Data Programmability for the Data Cloud
  • Software Spotlight: Elastic stack (ELK)

Data-driven Software: Towards the Future of Programming in Data Science

Organizations increasingly lean on data science to inform business decisions, but changes in the pipeline often trigger problems. Data-driven software (DDS) is an attempt to apply source control concepts over data. This article, though long and esoteric, shows you how to treat data as if it were code using DDS.

“We believe it is time to break down the barrier between code and data, making any piece of data instantly accessible as if it was a normal function call,” the author says. This is good food for thought regarding data architecture.

Learn all about data-driven software and see examples of code

Get the Scoop on New Snowflake Features Released this Summer

Learn the details of the many announcements made at the Snowflake Summit this year, including the release of enhancements around data programmability, data sharing, and global governance.

Snowflake also announced the ability to connect to the database via RestAPIs. This is a major convenience for developers so that they don’t have to worry about drivers or custom libraries. Snowflake is also cleaning up their admin interface and marking some of their programmability extensions as public preview. This is a good overview if you want a summary of the changes.

Read about the newest Snowflake features, like Snowpark and Java UDFs

Welcome to Snowpark: New Data Programmability for the Data Cloud

This article takes a closer look at the Snowflake announcements pertaining to the new data programmability features that make Snowflake more extensible and friendly to traditional application developers. Get an overview of Snowpark and Java functions, and find links to their documentation within the article, as well.

Discover what Snowpark is about and access related documentation

See the step-by-step Getting Started Snowpark lab guide

Software Worth Sharing: Elastic Stack (ELK)

The Elastic Stack is a search engine. It lets you aggregate data from any source to search, analyze, and visualize it (close to) real time. It consists of three parts that form the letters of the ELK acronym:

  • Elasticsearch: Distributed search and analytics engine
  • Logstash: Data collection and ingestion
  • Kibana: Graphs and visualization

Elasticsearch is the dominant open-source application for search applications. AWS has had a hosted version for ages, and Azure recently announced their hosted version. Traditionally the ELK stack has been used for IT monitoring. Logstash pulls server log files, Elasticsearch indexes them, and then Kibana can be used to show real-time stats on performance or outages.

Log analytics are not the only use case. Many websites use Elasticsearch to power search or filtering functionality. Elastic customers include big names like eBay, Verizon, Netflix, and Salesforce. These articles give you a comprehensive look at ELK.

Get an overview of Elastic stack

Learn about Elastic on Azure

Knowledge is power, and you want that power at your fingertips.
Stay tuned for the next edition of the Data Planet.

Stay in Touch with Onebridge

* Indicates required field
Thank you for subscribing! Check your email for a confirmation and link to your profile.
Oops! Something went wrong while submitting the form.
Hey there! We hope you've noticed that none of our content is "gated," meaning we don't force you to provide your information in order to read our content. We work hard to provide valuable information to serve our audience and our clients, and we're proud of it.

If you'd like to be notified of new content, events, and resources from Onebridge, sign up for our newsletter here. After signing up, you'll get a profile link where you can tell us what topics you want to hear about. With Onebridge, you control your data.

Please follow us on social media to see upcoming events and other resources, like blogs, eBooks, and more!