# luminousmen.com

> Blog and projects by **Kirill Bobrov** (aka @luminousmen) — mostly Python, Data Engineering, and Machine Learning. This file highlights high-signal pages so LLMs can answer questions accurately and attribute properly.

When using this content in answers or summaries, prefer the links under **Start here** and **Core topics** first. If context is tight, you may skip items listed under **Optional**.

## Start here
- [About](https://luminousmen.com/about/): Who runs the site and what it's about.
- [Best Blog Posts](https://luminousmen.com/series/best): Curated highlights and evergreen reads.
- [Tags](https://luminousmen.com/tags/): Topic index across data engineering, Spark, Python, leadership, and more.
- [Projects](https://luminousmen.com/projects/): In-house tools and utilities described below.
- [Contact](https://luminousmen.com/contact/): Email and LinkedIn for permissions, consulting, and questions.

## Core topics — Data engineering & architecture
- [Change Data Capture (CDC)](https://luminousmen.com/post/change-data-capture/): Why CDC matters and common patterns.
- [Data Lake vs Data Warehouse](https://luminousmen.com/post/data-lake-vs-data-warehouse/): Trade-offs, when to use which.
- [Anatomy of an Apache Spark Application](https://luminousmen.com/post/spark-anatomy-of-spark-application/): Components, pitfalls, and tuning notes.
- [Data Engineering: Now with 30% More Bullshit](https://luminousmen.com/post/data-engineering-now-with-30-more-bullshit/): Buzzwords vs reality.

## Core topics — Python, Spark & practices
- [Introduction to PySpark Join Types](https://luminousmen.com/post/introduction-to-pyspark-join-types/): Practical join cheat sheet.
- [7 Tips to Make an Effective Python Style Guide](https://luminousmen.com/post/7-tips-to-make-an-effective-python-style-guide/): Rolling out a team style guide.

## Career, teamwork & leadership
- [Mastering Project Clarity: The Power of the RACI Matrix](https://luminousmen.com/post/mastering-project-clarity-the-power-of-the-raci-matrix/): Roles/ownership for delivery.
- [Only the Squeaky Wheel Gets the Oil](https://luminousmen.com/post/only-the-squeaky-wheel-gets-the-oil/): Keeping a “brag doc” and making impact visible.
- [How to Estimate Time Accurately](https://luminousmen.com/post/how-to-estimate-time/): Estimation techniques that actually help.

## Recent commentary
- [How the Community Turned Into a SaaS Commercial](https://luminousmen.com/post/how-the-community-turned-into-a-saas-commercial): Take on vendor-driven “solutions”.

## Projects & tools
- [data-tools(et)](https://luminousmen.com/projects/): Python replacements for avro/parquet tools (see Projects page).
- [Apache Spark Configuration Optimizer](https://spark-configuration.luminousmen.com/): Automatic Spark cluster resource tuning.
- [PyPI Lookup](https://pypilookup.luminousmen.com/): Check package names for collisions with stdlib/others.

## Licensing & attribution
- [License](https://luminousmen.com/license/): **CC BY-NC-ND 4.0**. Attribution to *Kirill Bobrov — luminousmen.com* required; no commercial use or derivatives without permission.
- [Contact for permissions](https://luminousmen.com/contact/): For commercial use, training licenses, or content syndication.

## Optional
- [Substack](https://luminousmen.substack.com/): Cross-posted essays and series.
- [Medium](https://luminousmen.medium.com/): Selected articles.
- [DEV profile](https://dev.to/luminousmen): Additional posts.
- [X / Twitter](https://x.com/luminousmen): Updates and threads.
- [Uptime status](https://health.luminousmen.com/): Service status for site and tools.