How to evaluate a nearshore development partner (a CTO's checklist)
What to look for, what to avoid, and the questions most agencies hope you won't ask. From a team that's been on both sides of the table.
You’re looking for a nearshore development partner. You’ve googled it, you’ve landed on three Clutch lists and seven agency websites that all say the same things: “world class talent,” “agile methodology,” “transparent communication.” None of that helps you decide.
I’ve been on both sides of this. Before co-founding 5e, I was a developer at 1-800Accountant and BAC Credomatic. I’ve been the person an agency was pitching to, and now I’m the person doing the pitching. That gives me a decent view of what the evaluation process misses.
Here’s what I’d look at if I were hiring us. Or anyone else.
Skip the portfolio page. Ask for the ClickUp tour.
Every agency has a portfolio page with their six best projects, nice screenshots, vague descriptions. It tells you almost nothing about how they work day to day.
What you want is a look at their project management setup. Ask them to screen-share their PM tool. What does their task structure look like? How granular are the tickets? Are there actual sprint boards with real tasks, or is it a wasteland of empty lists? You can learn more about an agency in a 10-minute ClickUp walkthrough than in an hour-long sales call.
We use ClickUp. When a prospect asks to see it, we show it. If an agency hesitates, ask yourself why.
Check for retainer clients, not project count
Any agency can complete 100 projects. The question is how many clients came back. A company that builds your website, launches it, and vanishes is a vendor. A company that’s been maintaining your platform for three years is a partner.
We have clients who’ve been on monthly retainers for years. Media outlets, SaaS companies, fintech platforms. When we say we understand their product, we mean it. We’ve been in the codebase long enough to know where the technical debt lives and why it’s there.
Ask any agency you’re evaluating: how many of your current clients have been with you for more than a year? If they can’t name several, that tells you something.
Red flags I’d run from
No named team members on the website. If they won’t tell you who works there, you’re not hiring a team. You’re hiring a black box.
“We have 500+ developers.” That means they’re a staffing marketplace, not a development partner. The person assigned to your project was probably hired last week.
No clear process description. If they can’t explain how a project goes from kickoff to launch in specific terms (not “we follow agile”), they’re making it up as they go.
Pricing that seems too low. I know this sounds self-serving, but we’ve been hired to rescue projects from cheap agencies more times than I’d like to count. The cost of a $15K project that fails and needs a $40K rebuild is $55K. The cost of a $35K project that works is $35K.
Green flags that matter
Long client relationships. Already covered this, but it’s the single strongest signal.
Industry experience in your vertical. If you’re building a SaaS product and they’ve only done marketing websites, the learning curve will be on your dime. We work across SaaS, media, fintech, and health. Each has different patterns. A team that’s seen yours before moves faster.
Same timezone demos. If they can demo your project progress at 10am your time without scheduling gymnastics, that’s a practical indicator of how collaboration will feel for the next six months.
Design and development in one team. Most nearshore agencies are dev-only. That means you still need to find and manage a designer, and someone has to handle the handoff between them. We do both in the same sprint cycle, which cuts weeks off delivery.
Questions for the first call
These are the ones agencies don’t prep for:
-
“Walk me through your last project that went badly. What happened and how did you handle it?” Honest agencies have these stories. Perfect track records are fiction.
-
“If I message your team on Slack at 2pm EST on a Tuesday, how fast do I get a response?” The answer tells you more about communication culture than any sales deck.
-
“What would you do differently if you could redo your most recent project?” This tests whether they reflect on their work or just ship and move on.
-
“Can I talk to a current client, not one you’ve prepped?” Testimonials are curated. A live reference call is not.
The uncomfortable truth
Most agencies are fine. They’ll deliver something that works. The difference between fine and good is whether they push back when your requirements don’t make sense, whether they flag technical debt before it becomes a crisis, and whether they’re still there when something breaks at 9pm on a Friday.
That’s not something you can evaluate from a website. But you can evaluate it from the questions above. The agencies that answer them well are the ones worth your time.
And if you want to test us against this checklist, we’re happy to take the call.
Have a project in mind?
Get in TouchMore Articles
The real cost of a bad development agency
We've been hired to fix the mess. More than once. Here's what it costs and what the warning signs were.
ReadWhy SaaS companies are hiring developers in Costa Rica
The time zone, the talent, the cost. Why more US product teams are building with Costa Rica engineers.
ReadBuilding a news platform that doesn't crash on breaking news
What happens when traffic spikes 10x in 30 minutes, and what we've learned from building 5+ media platforms that handle it.
Read