You didn’t describe exactly what your setup is (or even what your product is, but I’m guessing some kind of CRUD web system…). Here’s what I would do if I was in your position:
Set up a sandbox with Opus 5.5 and an agent harness in it (e.g. Codex, Pi or OpenCode).
Most importantly, give it access to your source code, and a way to run a dev environment (set up the database etc.).
Feed it all the info with PII removed as you are (good work btw).
Write some skills, based on your previous experience - you mentioned having to tell it to check things repeatedly, you can just write those things down for it.
The absolute most important things are that it has access to the source code (and documentation if you have any lol), and an environment where it can actually try things out. If you think about it, that makes things way easier for humans too so it’s not really that surprising. If I gave you a bunch of C++ and said “where’s the syntax error”, it’s a much easier task for both humans and AI if you have access to a C++ compiler.
It’s in the hospitality industry. I have to make sure the separate guest profile systems align between bookings, crm, identity, and authentication. Each has a unique data store with different requirements (booking data is allowed to be bullshit because we just want that sale with zero friction) but eventually the systems must be aligned, so the system has to join identities between all systems based on matching a preponderance of PII, while also allowing someone to get a name change through marrying, move to a different location, go by a nickname, or someone made up a birthdate because they couldn’t guess. Also we have to not incorrectly merge because that creates a data spillage.
You didn’t describe exactly what your setup is (or even what your product is, but I’m guessing some kind of CRUD web system…). Here’s what I would do if I was in your position:
The absolute most important things are that it has access to the source code (and documentation if you have any lol), and an environment where it can actually try things out. If you think about it, that makes things way easier for humans too so it’s not really that surprising. If I gave you a bunch of C++ and said “where’s the syntax error”, it’s a much easier task for both humans and AI if you have access to a C++ compiler.
It’s in the hospitality industry. I have to make sure the separate guest profile systems align between bookings, crm, identity, and authentication. Each has a unique data store with different requirements (booking data is allowed to be bullshit because we just want that sale with zero friction) but eventually the systems must be aligned, so the system has to join identities between all systems based on matching a preponderance of PII, while also allowing someone to get a name change through marrying, move to a different location, go by a nickname, or someone made up a birthdate because they couldn’t guess. Also we have to not incorrectly merge because that creates a data spillage.
Fun times.