Skip to main content
Globalbit
Back to Blog
Hiring an AgencyBest Practices

How to Evaluate a Software Agency's Portfolio (What Most People Miss)

Published Updated ·Vadim Fainshtein
How to Evaluate a Software Agency's Portfolio (What Most People Miss)

TL;DR: Every agency shows pretty screenshots and big logos. What separates real capability from presentation skill is whether the work is live, whether the agency can explain what they built versus what someone else built, and whether the outcomes match what was promised. Here's a framework for evaluating portfolios that catches the gaps most buyers miss.

Why portfolio evaluation goes wrong

You visit an agency's website. You see impressive projects: healthcare platforms, fintech apps, government systems. The screenshots look polished. The company logos look big. You're impressed.

Then you hire them, and the team assigned to your project has never built anything like those showcase projects. The senior architect on the case study left two years ago. The "platform" they show was actually a small module inside a larger system built by someone else.

This happens constantly. Not because agencies are dishonest, but because portfolios are marketing tools. Your job is to look past the marketing and find the signal.

The five-layer evaluation framework

Layer 1: Is the project live?

The most basic test, and the one most buyers skip. If the project is in the portfolio, you should be able to use it.

  • Web apps: Visit the URL. Is it operational? Is the performance acceptable? Do the features match what's described?
  • Mobile apps: Download and use the app. Check the App Store / Google Play reviews. What do actual users say?
  • Enterprise systems: Ask for a demo or access to a staging environment if the system isn't public.

If the agency can't show you live products, ask why. Legitimate reasons exist (NDA, internal tools, sunset products). But if none of their portfolio is verifiable, that's a concern.

What we show at Globalbit: IBI Smart (download it: it's the #1 trading app in Israel, with 500,000+ active users), Moovit (1.7 billion users worldwide) and Espresso Club's digital platform. Real products. Real users. Real App Store reviews.

Layer 2: What exactly did they build?

This is where portfolio reviews break down. An agency lists "Moovit" in their portfolio. But did they build the entire app? One feature? The backend? The onboarding flow?

Questions to ask:

  • "What specific components or features did your team build?"
  • "How many developers worked on this, and for how long?"
  • "What was your team responsible for versus the client's internal team or other vendors?"
  • "Can I speak with the technical lead who managed this project?"
Background

Let's Talk

Ready to rethink how your team builds software? Let's share what we've learned.

Honest agencies will be specific. "We built the real-time transit tracking module and the notification system. The core routing engine was built by the client's team." Vague agencies will redirect: "We can't discuss details due to NDA."

NDAs are real, but they rarely prevent discussing the type of work done. "We built a real-time data pipeline for a major transportation company" is NDA-safe and informative.

Layer 3: Test the quality, not just the appearance

Screenshots show design. They don't show engineering quality. Here's how to look deeper:

For web applications:

  • Run a Lighthouse audit (Chrome DevTools → Lighthouse). Check performance, accessibility, and best practices scores.
  • Test mobile responsiveness. Does it work on a phone?
  • Check page load times. Anything over 3 seconds is below modern standards.
  • Look at the URL structure and SEO basics. Competent agencies don't ignore SEO.

For mobile apps:

  • Check crash rates in App Store / Google Play reviews
  • Look at the last update date. An app not updated in 12+ months is either abandoned or technically stagnant.
  • Test basic flows. Does onboarding work smoothly? Do transitions feel native?

For API/backend systems:

  • Ask about uptime and reliability metrics
  • Request information about how the system handles load
  • Ask what monitoring and alerting is in place

Layer 4: Outcomes, not outputs

The hardest layer to evaluate, but the most telling. Did the project achieve what it was supposed to?

Questions to ask:

  • "What business metrics improved after launch?"
  • "Did the project ship on time and within budget?"
  • "What happened after the initial launch? Were there iterations?"
  • "Is the client still working with you? If not, why?"

Strong answers sound like: "The customer portal reduced support calls by 35%. The client expanded the project to three more countries." Weak answers sound like: "The client was satisfied with our work."

Request references. Not the references the agency provides (those are curated) — ask for references from projects similar to yours in scope, technology, and industry.

Layer 5: Team continuity

The portfolio shows what the agency built with a specific team at a specific time. Your project will be built by today's team.

Questions to ask:

  • "Are the key people from these portfolio projects still at your company?"
  • "Who would be the tech lead on my project? What's their portfolio?"
  • "What's your team turnover rate?"
  • "Can I interview the developers who'd work on my project?"

An agency with 25% annual turnover will have a completely different team every four years. The people who built the impressive portfolio project may have moved on. That doesn't invalidate the work, but it should factor into your evaluation.

Red flags in portfolios

SignalWhat it might mean
All projects are from 5+ years agoThe agency may have talent or capability gaps today
No live projects available to testThe work may not have survived production use
Vague descriptions of the agency's roleThe agency's contribution may have been limited
No before/after metricsThe agency may not track outcomes
Every project is a different technology stackThe agency may lack deep expertise in any one area
Reluctance to provide referencesPrevious clients may not have had good experiences
Portfolio only shows design, no technical depthThe agency may outsource development

Green flags in portfolios

SignalWhat it means
Live, actively maintained productsThe work was good enough to survive production
Specific metrics and outcomes citedThe agency measures and delivers results
Long-term client relationshipsClients found the work good enough to continue
Willing to explain what they did vs. what others builtHonest about their role and contribution
Team members you'd work with have portfolio historyYour project gets experienced people, not juniors
Technology consistency across projectsDeep expertise, not a jack-of-all-trades

The 30-minute portfolio evaluation checklist

If you're short on time, here's a fast evaluation you can run in a single call with the agency:

  1. Pick 2-3 projects from their portfolio that are most similar to yours
  2. For each: "What exactly did your team build, and what was the team size?"
  3. For each: "Is this live? Can I use it or see a demo?"
  4. For each: "What business outcomes did the client achieve?"
  5. "Can I talk to the client from one of these projects?"
  6. "Who from these projects would work on mine?"

If the agency answers all six with specifics, they're worth a deeper evaluation. If they deflect on more than two, keep looking.

Beyond the portfolio: signs of a strategic partner

A portfolio shows what an agency has built. How they engage with your project shows whether they'll act as a partner or as a vendor that turns specs into tickets. Watch for three signals:

They challenge your requirements. A good partner tells you when a feature will cost $200K and serve 3% of your users, then proposes a simpler version that covers most of the need.

They learn your domain. A team building a healthcare system should understand clinical workflows. A team building fintech should know the securities rules. Expect the partner to spend real time in your operations before writing code.

They plan for life after launch. Launch starts the product's life. Post-launch optimization, user feedback and ongoing architecture decisions need people who know the product's history.

Choosing wrong is expensive. Switching partners mid-project loses 3-6 months of accumulated knowledge and adds 2-3 months of onboarding for the new team.

Frequently asked questions

How many portfolio projects is enough? Quality over quantity. Three to five projects that are similar to yours in scope, technology, and industry matter more than 50 generic case studies. If none of their portfolio matches your domain, they'll be learning on your dime.

What if the agency has NDA restrictions on their best work? Legitimate, especially for enterprise and government projects. They should still be able to describe the type of work, the technology stack, the team size, and the challenges they solved — without naming the client. If they can't discuss anything, that's suspicious.

Should I weigh design quality or engineering quality more? Engineering quality. Good design on top of bad code leads to a product that looks great and breaks constantly. Bad design on top of good code can always be redesigned. The best agencies deliver both, but if you have to pick one to evaluate, go deeper on the engineering.

How can I test an agency's thinking before signing? Give them one of your real technical challenges to review. A vendor proposes a solution on the spot. A strategic partner asks clarifying questions first.

How does Globalbit demonstrate its portfolio? Our case studies name the client, state what we built and give measurable outcomes, and every project on our portfolio page has live links and named team members who still work here. We've delivered 200+ projects across fintech, healthcare, government, retail and AI, and 80% of our clients stay with us for four years or more. Our longest client relationship spans 10+ years. A few examples of long relationships:

  • [Egged](/cases/egged): a 3-month rescue took the app from 2.2 to 4.7 stars and grew into a 5-year partnership as Egged's mobile team.
  • [Care Laser](/cases/care-laser): a 5+ year partnership, from a 6-month rollout across 33 clinics to ongoing development.
  • [Espresso Club](/cases/espresso-club): 4 years building the brand's apps and website, now used by 350,000+ monthly active customers.

See our work and talk to our team.

[ NEWSLETTER ]

New articles, once a week

One short email a week with the articles we published on the blog.

We keep your email, your name if you add it, and your consent, and use them only to send this update. Read our privacy policy.

[ CONTACT US ]

Tell us what you’re building.

Trusted by 250+ organizations. We respond within one business day.

By submitting, you agree that we may contact you and use your details to measure and improve our advertising, per our privacy policy.

Discuss your Project →