jarvisemitra
SHL Assessment Recommender - Full implementation with hybrid retrieval, slot-based conversation analysis, safety guards, and evaluation harness
ae3c639
|
Raw
History Blame Contribute Delete
10.6 kB

A newer version of the Gradio SDK is available: 6.20.0

Upgrade

Conversation

Turn 1

User

Here's the JD for an engineer we need to fill. Can you recommend an assessment battery?

"Senior Full-Stack Engineer β€” 5+ years across Core Java, Spring, REST API design, Angular, SQL/relational databases, AWS deployment, and Docker. Will own end-to-end microservice delivery, contribute to architectural decisions, and mentor mid-level engineers. Strong CI/CD and cloud-native experience required."

Agent

That JD spans seven distinct areas β€” Core Java, Spring, REST APIs, Angular, SQL, AWS, and Docker. The catalog has dedicated knowledge tests for each. A focused recommendation needs to know what the candidate will actually own. To narrow this down:

Is this a backend-leaning role (Java / Spring / SQL heavy) or a frontend-heavy role or a true balanced full-stack role with significant Angular work?

No recommendations this turn (recommendations: null).

end_of_conversation: false

Turn 2

User

Backend-leaning. Day-one priorities are Core Java and Spring; SQL is constant. Angular is occasional β€” they'd review frontend PRs but not own features.

Agent

Understood β€” Java, Spring, and SQL as primary; Angular as secondary review-only. One more question before I shape the battery: is the seniority closer to a senior IC (deep backend ownership, leads design on their service) or a tech lead (sets architecture across services, reviews other engineers' work)? That changes whether we lean on a knowledge-heavy battery or add a leadership/scenarios layer.

No recommendations this turn (recommendations: null).

end_of_conversation: false

Turn 3

User

Senior IC. They lead design on their own services but don't manage other engineers directly.

Agent

For a senior IC backend engineer with Java / Spring / SQL primary and Angular secondary, here's a first shortlist focused on what they'll actually own:

# Name Test Type Keys Duration Languages URL
1 Core Java (Advanced Level) (New) K Knowledge & Skills 13 minutes English (USA) https://www.shl.com/products/product-catalog/view/core-java-advanced-level-new/
2 Spring (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/spring-new/
3 RESTful Web Services (New) K Knowledge & Skills 12 minutes English (USA) https://www.shl.com/products/product-catalog/view/restful-web-services-new/
4 SQL (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/sql-new/
5 SHL Verify Interactive G+ A Ability & Aptitude 36 minutes English (USA), Chinese Traditional, Korean, Serbian (+29 more) https://www.shl.com/products/product-catalog/view/shl-verify-interactive-g/
6 Occupational Personality Questionnaire OPQ32r P Personality & Behavior 25 minutes English International, French (Canada), Portuguese, Chinese Simplified (+35 more) https://www.shl.com/products/product-catalog/view/occupational-personality-questionnaire-opq32r/

end_of_conversation: false

Turn 4

User

Add AWS and Docker. Drop REST β€” the API design signal will already come through in Spring and the live interview.

Agent

Updated β€” REST out, AWS and Docker in:

# Name Test Type Keys Duration Languages URL
1 Core Java (Advanced Level) (New) K Knowledge & Skills 13 minutes English (USA) https://www.shl.com/products/product-catalog/view/core-java-advanced-level-new/
2 Spring (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/spring-new/
3 SQL (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/sql-new/
4 Amazon Web Services (AWS) Development (New) K Knowledge & Skills 6 minutes English (USA) https://www.shl.com/products/product-catalog/view/amazon-web-services-aws-development-new/
5 Docker (New) K Knowledge & Skills 10 minutes English (USA) https://www.shl.com/products/product-catalog/view/docker-new/
6 SHL Verify Interactive G+ A Ability & Aptitude 36 minutes English (USA), Chinese Traditional, Korean, Serbian (+29 more) https://www.shl.com/products/product-catalog/view/shl-verify-interactive-g/
7 Occupational Personality Questionnaire OPQ32r P Personality & Behavior 25 minutes English International, French (Canada), Portuguese, Chinese Simplified (+35 more) https://www.shl.com/products/product-catalog/view/occupational-personality-questionnaire-opq32r/

end_of_conversation: false

Turn 5

User

On Java β€” they'd be working on existing services, not greenfield. Is the Advanced level the right pick?

Agent

Yes. Advanced covers concurrency, JVM internals, performance tuning, and the kind of design-level Java that comes up when extending production microservices β€” which matches "owns end-to-end microservice delivery". The Entry-Level test is calibrated for graduate hires reading and modifying existing code, which undershoots a senior IC. Keeping Advanced.

# Name Test Type Keys Duration Languages URL
1 Core Java (Advanced Level) (New) K Knowledge & Skills 13 minutes English (USA) https://www.shl.com/products/product-catalog/view/core-java-advanced-level-new/
2 Spring (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/spring-new/
3 SQL (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/sql-new/
4 Amazon Web Services (AWS) Development (New) K Knowledge & Skills 6 minutes English (USA) https://www.shl.com/products/product-catalog/view/amazon-web-services-aws-development-new/
5 Docker (New) K Knowledge & Skills 10 minutes English (USA) https://www.shl.com/products/product-catalog/view/docker-new/
6 SHL Verify Interactive G+ A Ability & Aptitude 36 minutes English (USA), Chinese Traditional, Korean, Serbian (+29 more) https://www.shl.com/products/product-catalog/view/shl-verify-interactive-g/
7 Occupational Personality Questionnaire OPQ32r P Personality & Behavior 25 minutes English International, French (Canada), Portuguese, Chinese Simplified (+35 more) https://www.shl.com/products/product-catalog/view/occupational-personality-questionnaire-opq32r/

end_of_conversation: false

Turn 6

User

Do we really need Verify G+ on top of all the technical tests? Feels redundant.

Agent

Not redundant β€” they measure different things. The technical tests confirm the candidate already knows the stack. Verify G+ measures general reasoning ability, which predicts how quickly they'll learn parts of the stack they haven't seen and adapt when production throws something unfamiliar at them. For a senior IC making architectural calls, that signal matters. That said, if you want a leaner shortlist, dropping Verify G+ is a valid tradeoff and the battery still stands. Your call.

# Name Test Type Keys Duration Languages URL
1 Core Java (Advanced Level) (New) K Knowledge & Skills 13 minutes English (USA) https://www.shl.com/products/product-catalog/view/core-java-advanced-level-new/
2 Spring (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/spring-new/
3 SQL (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/sql-new/
4 Amazon Web Services (AWS) Development (New) K Knowledge & Skills 6 minutes English (USA) https://www.shl.com/products/product-catalog/view/amazon-web-services-aws-development-new/
5 Docker (New) K Knowledge & Skills 10 minutes English (USA) https://www.shl.com/products/product-catalog/view/docker-new/
6 SHL Verify Interactive G+ A Ability & Aptitude 36 minutes English (USA), Chinese Traditional, Korean, Serbian (+29 more) https://www.shl.com/products/product-catalog/view/shl-verify-interactive-g/
7 Occupational Personality Questionnaire OPQ32r P Personality & Behavior 25 minutes English International, French (Canada), Portuguese, Chinese Simplified (+35 more) https://www.shl.com/products/product-catalog/view/occupational-personality-questionnaire-opq32r/

end_of_conversation: false

Turn 7

User

Keep Verify G+. Locking it in.

Agent

Final battery β€” Java Advanced, Spring, SQL, AWS, and Docker as the technical core; Verify G+ for reasoning; OPQ32r for personality fit on a senior IC who'll mentor and contribute to architecture.

# Name Test Type Keys Duration Languages URL
1 Core Java (Advanced Level) (New) K Knowledge & Skills 13 minutes English (USA) https://www.shl.com/products/product-catalog/view/core-java-advanced-level-new/
2 Spring (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/spring-new/
3 SQL (New) K Knowledge & Skills 9 minutes English (USA) https://www.shl.com/products/product-catalog/view/sql-new/
4 Amazon Web Services (AWS) Development (New) K Knowledge & Skills 6 minutes English (USA) https://www.shl.com/products/product-catalog/view/amazon-web-services-aws-development-new/
5 Docker (New) K Knowledge & Skills 10 minutes English (USA) https://www.shl.com/products/product-catalog/view/docker-new/
6 SHL Verify Interactive G+ A Ability & Aptitude 36 minutes English (USA), Chinese Traditional, Korean, Serbian (+29 more) https://www.shl.com/products/product-catalog/view/shl-verify-interactive-g/
7 Occupational Personality Questionnaire OPQ32r P Personality & Behavior 25 minutes English International, French (Canada), Portuguese, Chinese Simplified (+35 more) https://www.shl.com/products/product-catalog/view/occupational-personality-questionnaire-opq32r/

end_of_conversation: true