Home | Tech Vault

Running services in AWS free tier

Using EC2, terraform and lambda

Posted on December 17, 2024

AWS is the most popular major cloud provider, and getting starting with their free tier is quite easy. My own experience is mainly with azure for the projects I have... [Read More]
Tags:
- aws
- ec2
- terraform
- aws-lambda
Incremental pipeline with delta and polars

How to apply watermark pipelines at a small scale with Change Data Feed

Posted on November 29, 2024

After reading an article about implementing a poor’s man datalake using Polars and Delta I thought I needed to give it a go. Coming from Spark, I was familiar with... [Read More]
Tags:
DBT for Spark

Posted on August 25, 2023

I have been seeing a lot about DBT this last year. I was doing some research for Databricks Live Tables (DLT) and found this article that compares DBT and DLT... [Read More]
Tags:
- databricks
- azure
- dbt
Azure CosmosDB Vector Search with LlamaIndex

Implementing Vector Searches in Azure with LlamaIndex and CosmosDB for MongoDB vCore

Posted on July 1, 2023

Why vector database in Azure? [Read More]
Tags:
- azure
- llm
- llama-index
A Solution to Check if Resource Exists in Azure Biceps

Making bicep deployments idempotent

Posted on April 14, 2023

Azure Biceps is a Domain-specific language for deploying Azure resources declaratively. Azure Biceps makes it easy to manage resources using code. However, a significant limitation of Azure Biceps is the... [Read More]
Tags:
- azure
- devops
- biceps

Older Posts

Running services in AWS free tier

Using EC2, terraform and lambda

Incremental pipeline with delta and polars

How to apply watermark pipelines at a small scale with Change Data Feed

DBT for Spark

Azure CosmosDB Vector Search with LlamaIndex

Implementing Vector Searches in Azure with LlamaIndex and CosmosDB for MongoDB vCore

A Solution to Check if Resource Exists in Azure Biceps

Making bicep deployments idempotent