Insights, tutorials, and best practices for modern software testing
While ChatGPT can be immensely helpful, it’s not a full test automation engine. It shines in specific areas and falls short in others. Understanding that balance is key to using it well.
Analysis
Large orgs need more than a cool demo. You need coverage across complex stacks, stable execution at scale, enterprise controls and low maintenance.
Analysis
We love LLMs and use them everywhere we can, from our product to our internal workflows. But despite all the hype, we're nowhere near "agents writing most of our code."
Veith Röthlingshöfer
Create tests when committing code automatically - test batch generation of out of CI pipeline, test analytics and a SaaS designer talking. And month worth of shipped features from our Chief Product Officer.
Daniel Rödler
Octomind is a software testing SaaS platform with fairly sophisticated UI. From the very beginning, we put effort into a good UX/UI. Design of the product was an inevitable part of it. This is how we've built our design system.
Dániel Z. Aczél
This checklist lays out practical technology stacks for most common application types - SaaS, e-commerce, and canvas-based apps - and covers major testing categories from e2e to API testing.
Guide
There's not much a developer hates more than a blocked pipeline by a flaky test. If the blocker is a real bug, no one argues - better to stop a bad merge than fire-drill it in production. But if the blocker turns out to be a flaky test?
Daniel Rödler
We focused on tools that (1) generate or maintain tests with AI / agents, (2) cover real world testing use cases and features, (3) integrate with CI/CD, and (4) reduce flakiness and maintenance toil.
Analysis
Here are 6 reasons why we believe automated, AI-powered e2e tests belong to every development pipeline - for the benefit of both the code and the people who build it.
Daniel Rödler
We had a firm rule: no arbitrary sleeps in Octomind tests. Whenever someone asked, we pushed back. A hard-coded wait only papers over real bugs - and how do you even choose a number?
Kosta Welke
I see AI as a valuable tool, but only that. Something that can help you if used correctly and sanely, and can cause issues when letting it run rampant.
Daniel Draper
AI in testing - how do IDEs compare with testing platforms? When are you better off with an agentic IDE scripting e2e tests and when would you use an AI testing platform?
Daniel Rödler
Last week's open-sourcing of our MCP implementation is our contribution to the ecosystem. This week we are launching on Product Hunt. Let's turn testing from afterthought into a first-class citizen together.
Marc Mengler
Isolating context, tests, and data before execution makes running tests against multiple environments and parallelization possible. This is not a "best practice", but the way I see end-to-end test isolation.
Daniel Draper
Not all AI in e2e testing is created equal. To deploy AI to testing successfully, you have to address concerns of brittleness, interpretability, and clunkiness. Mitigation strategies depend on the testing stage.
Daniel Rödler
Test automation was never just the problem of creating scripts, but a challenge of proper setup and context. Autonomous testing tools should look at test automation as a whole and go beyond simple scripting to be useful.
Daniel Draper
There's more to test automation than simply creating scripts to automate test cases you would execute manually. Testing automation is highly analytical and requires a good knowledge of the system under test.
Veith Röthlingshöfer
An Octomind tutorial for developers who want start end-to-end testing. Let me show you what getting up to speed with Octomind looks like so you can see if it's something you'd want to try out for your own websites or apps.
Daniel Rödler
A backlog is a collection of tasks that aren't important enough to do. If they were, we wouldn't be stashing them away. After years in software development I've come to see backlogs as more of a hindrance than a help.
Daniel Draper
When abstractions do more harm than good - lessons learned using LangChain in production and what we should've done instead.
Fabian Both
Flaky e2e tests are frustrating for QA and development teams, causing constant disruptions and eroding trust in test outcomes. A fail-safe checklist for how you can tell the difference.
Maxi Link
We've raised $4.8 m to reinvent testing with AI. Led by Cherry Ventures, the round supports the developer tool's ambitions to create a bug-free future for AI-assisted software development and testing.
Octoneers
When done right, end-to-end tests are invaluable tools for comprehensively testing a backend. Working e2e tests is in everyone's interest, whether you are on frontend, backend, engineering or QA.
Daniel Draper
To build a better way of testing we needed a testing framework to complement our AI agents. Our ideal end-to-end testing tool would help build high quality apps fast.
Daniel Rödler
How do we get quality back on track while keeping the productivity benefits of tools like Copilot? After all, degrading quality undermines delivery speed and neutralizes some of the gains, if not most.
Daniel Rödler
Post mortem on a weekend of missed opportunity. What we've learned on moving fast and making sure we don't break things thanks to an unexpectedly viral blog posted to a subreddit on a Friday afternoon.
Octoneers
Software testing is littered with strong opinions and i'm no different. What, when, who, how and if to test at all is the subject of heated discussions. About the one dogma I'm guilty of - testing what you've built.
Daniel Draper
Deploying on Fridays is a legend of programming memes - a practice only fools engage in. Being completely averse to Friday releases can come across as dogmatic. My take #3 on popular developer dogmas.
Daniel Draper
An attempt for reconciliation between TypeScript lovers and haters. I'm firmly in the TypeScript camp. However, using typescript is also not an absolute.
Daniel Draper
Opinions in software engineering have gotten more extreme lately. I'll use some notorious examples to show that nuance is an essential engineering principle.
Daniel Draper
The unpredictable and non-deterministic nature of LLM output makes ensuring type safety hard. Lessons I learned about parsing and error handling of LangChain.
Veith Röthlingshöfer
Change is ubiquitous in software development. New languages, tools and frameworks are everywhere. Yet the one thing unwilling to move is the Testing Pyramid.
Marc Mengler