Bodo Blog

Bodo Dataframe Library: First Look

Rethinking DataFrames: Easy as Pandas, Fast as a Data Warehouse

DataFrames have become the go-to abstraction for working with structured data in Python—and for good reason. Lightweight, intuitive, and versatile, libraries like Pandas have empowered millions of developers to explore and transform data easily. But as the scale and complexity of workloads have grown, a new question has emerged...

Key Takeaways from Iceberg Summit 2025

A few of us from Bodo recently attended the Iceberg Summit, and it was great to see how Iceberg is rapidly evolving to meet the demands of modern data infrastructure. As long-time champions of open table formats and scalable analytics, we were excited not just to attend—but also to contribute...

Data Processing Engines Comparison Pt 2.

We will use the same workload and settings from the previous analysis and provide new implementations in both Daft and Polars. To recap, this workload summarizes monthly taxi and rideshare trips from New York City’s Taxi and Limousine Commission (TLC) and precipitation data from Central Park weather observations...

How to parallelize your LLM inference calls with Bodo

Large Language Models (LLMs) can be computationally intense and inference speed can quickly become a bottleneck—especially when you're sending multiple queries and waiting for responses. Slow response times don’t just lead to delays; they make real-time applications impractical, drive up compute costs, and create scalability challenges...

Bodo vs. Numba: Choosing the Right Tool for High-Performance Python

When it comes to efficient number crunching in Python, two powerful tools are Bodo and Numba. Both aim to speed up Python code using compilation techniques. While there is some overlap in the domains they support, there are notable performance differences, and each has unique areas of support that the other does not...

Bodo ♥️ PyIceberg: Scalable IO with the Simplicity of Python

Apache Iceberg is an open table format that provides simple, reliable, and scalable tables that are interoperable across various data tools such as compute engines. At Bodo, we believe that Iceberg is the future of data warehouse and data lake solutions due to its flexibility and open-source backing. However, using Iceberg at a large scale often requires Java-based tools which are difficult for developers to use and maintain.

Parallel FASTA Aggregation with Bodo: A Python Example for Scalable Bioinformatics

In modern bioinformatics, large-scale genomic data is the norm, requiring efficient ways to read, process, and combine massive collections of sequence files for meaningful analyses. Reading multiple large FASTA files—a routine step in genomics—can become a bottleneck when datasets scale. This post shows how to efficiently parse and combine FASTA sequences in parallel using Bodo...

Using Bodo to Read and Write Amazon S3 Tables in Python

AWS S3 Tables is a new service that simplifies Iceberg open table format usage by providing setup and maintenance of Iceberg tables automatically. This includes built-in table maintenance and optimization, which simplifies managing large datasets. However, the main option currently for using S3 Tables is Apache Spark, which requires complex configuration and a Java-based engine...

Run any Python library in parallel with @bodo.wrap_python

Python’s ecosystem is filled with powerful libraries, and the last few years have made it the go-to language for machine learning and AI. However, running custom operations from these libraries in parallel is challenging because it is a hassle to use anything but built-in operations in most parallel engines. This complexity often leads to tedious workarounds or suboptimal performance.

Bodo is Going Open Source – HPC Meets Python for data and AI

When we started Bodo, we had a clear mission: to make high-performance computing (HPC) as simple as possible. Along the way, we tackled some of the most challenging problems in parallel computing—achieving unprecedented performance and efficiency while maintaining ease of use. Today, we are proud to take that mission to the next level: The Bodo compute engine is now open source, bringing HPC to all data and AI workloads.

Python data processing engine comparison with NYC Taxi trips (Bodo vs. Spark, Dask, Ray)

We compared popular Python data processing engines using the NYC Taxi dataset to evaluate performance and scalability. The results revealed significant differences, highlighting how the right engine can optimize both speed and cost for data-intensive workloads.