Bodo Blog

The latest news, insights, product release information, guides, and everything in between from the Bodo team.

February 26, 2025

Bodo ♥️ PyIceberg: Scalable IO with the Simplicity of Python

Apache Iceberg is an open table format that provides simple, reliable, and scalable tables that are interoperable across various data tools such as compute engines. At Bodo, we believe that Iceberg is the future of data warehouse and data lake solutions due to its flexibility and open-source backing. However, using Iceberg at a large scale often requires Java-based tools which are difficult for developers to use and maintain.

February 20, 2025

Parallel FASTA Aggregation with Bodo: A Python Example for Scalable Bioinformatics

In modern bioinformatics, large-scale genomic data is the norm, requiring efficient ways to read, process, and combine massive collections of sequence files for meaningful analyses. Reading multiple large FASTA files—a routine step in genomics—can become a bottleneck when datasets scale. This post shows how to efficiently parse and combine FASTA sequences in parallel using Bodo...

February 12, 2025

Using Bodo to Read and Write AWS S3 Tables in Python

AWS S3 Tables is a new service that simplifies Iceberg open table format usage by providing setup and maintenance of Iceberg tables automatically. This includes built-in table maintenance and optimization, which simplifies managing large datasets. However, the main option currently for using S3 Tables is Apache Spark, which requires complex configuration and a Java-based engine...

January 30, 2025

Run any Python library in parallel with @bodo.wrap_python

Python’s ecosystem is filled with powerful libraries, and the last few years have made it the go-to language for machine learning and AI. However, running custom operations from these libraries in parallel is challenging because it is a hassle to use anything but built-in operations in most parallel engines. This complexity often leads to tedious workarounds or suboptimal performance.

January 27, 2025

Bodo is Going Open Source – HPC Meets Python for data and AI

When we started Bodo, we had a clear mission: to make high-performance computing (HPC) as simple as possible. Along the way, we tackled some of the most challenging problems in parallel computing—achieving unprecedented performance and efficiency while maintaining ease of use. Today, we are proud to take that mission to the next level: The Bodo compute engine is now open source, bringing HPC to all data and AI workloads.

January 20, 2025

Python data processing engine comparison with NYC Taxi trips (Bodo vs. Spark, Dask, Ray)

We compared popular Python data processing engines using the NYC Taxi dataset to evaluate performance and scalability. The results revealed significant differences, highlighting how the right engine can optimize both speed and cost for data-intensive workloads.

February 13, 2024

2023 Review and Looking Ahead to 2024

2023 was a pivotal year for Bodo’s mission to bring High Performance Computing levels of efficiency, performance, and scalability to data workloads. From building a vectorized SQL engine to a new cloud service architecture, there are several milestones to celebrate. Let’s review some of the highlights of 2023 and look ahead to possibilities in 2024.

March 22, 2023

Moving Seamlessly from Development Environments to Production Realities

Bodo’s UI makes deploying, managing, and monitoring jobs running on notebooks or in production simple—enabling you to connect with terabytes of data and use job scheduling to turn your interactive notebooks into production jobs.

November 23, 2022

2022 at Bodo: A Year in Review

Bodo has accomplished so much this year, we wanted to take a moment to reflect on some of our highlights as 2022 comes to a close.

August 4, 2022

Bodo & Iceberg: The Simple and Fast Open Data Warehouse of the Future

Bodo on Iceberg simplifies data management for users substantially by supporting native Python (in addition to SQL). The connector eliminates the need for an involved setup process and parameter tuning to make sure data engineers and data scientists are solving business problems instead of fighting data infrastructure.

July 7, 2022

Creating ETL Pipelines With Bodo

In this post, we look at some of the considerations you may want to keep in mind when building an ETL pipeline similar to the data collection and exploration as seen...

June 1, 2022

Bodo Now Available on Saturn Cloud

Over the last few months, Bodo and SaturnCloud have worked together to provide a joint solution with Bodo software running within Saturn Cloud resources. Data scientists can now access...