Batch and Streaming Pipelines

One of the best features of Databricks is that it facilitates transitioning batch pipelines to streaming pipelines.

Databricks Jobs

Today’s post will cover Databricks Jobs. There is also the concept of a Spark Job which will be covered briefly to try to avoid confusion.

Databricks Clusters

This is a continuation of my series of posts on Databricks where we most recently reviewed the Workspace & Notebooks. Now let’s get more familiar with the concept of clusters. […]

Workspaces & Notebooks

Now that you’ve instantiated the Databricks service within Azure, let’s take a tour of the workspace & become familiar with Notebooks. Workspace The above image shows the Databricks homepage of […]

Intro to Azure Databricks

Many companies today have aging data architectures. As you look to modernize your traditional ETL pipeline, there is a tool you should keep in mind: Azure Databricks. During your move […]

Azure Resources: Saving Time And Money

Money is always important whether you are developing for yourself, your employer, or a client. One way to save money in Azure is to shut down resources at the end […]

Scripting Azure Synapse Analytics

Background Development on Azure Synapse Analytics (formerly Azure SQL Data Warehouse) is progressing at a rapid pace. Recently, in April 2020, the new workspaces preview was released. This is an […]

Atmosera is thrilled to announce that we have been named GitHub AI Partner of the Year.

X