Creating Custom Agents
While SkillShop’s system agents cover many common educational tasks, you can create custom agents tailored to your specific needs, teaching style, or unique educational contexts. Custom agents allow you to define specialized expertise, behavior, and tool access.Custom agents use the same powerful infrastructure as system agents but can be personalized for your specific educational requirements and workflows.
When to Create Custom Agents
Consider creating custom agents when you need:Specialized Expertise
Subject-specific knowledge not covered by system agents (e.g., specialized medical training, niche technical skills)
Unique Teaching Style
Agents that match your specific pedagogical approach or institutional requirements
Custom Workflows
Agents designed for your organization’s specific processes and procedures
Targeted Audiences
Agents optimized for specific student populations, age groups, or learning contexts
Agent Creation Process
Step 1: Access Agent Creation
1
Navigate to Agents
Go to the Agents section in SkillShop’s main navigation
2
Click Create Agent
Use the “Create Agent” button in the top-right corner of the agents page
3
Choose Agent Type
Select “Custom Agent” to create a new agent from scratch
Step 2: Basic Configuration
- Identity
- Category
- Visibility
Agent Name: Unique identifier (no spaces, lowercase with underscores)Display Name: Human-readable name shown in the interfaceDescription: Clear explanation of the agent’s purpose and capabilities
Step 3: System Prompt Design
The system prompt is the most important part of your agent - it defines the agent’s personality, expertise, and behavior patterns. SkillShop uses advanced template processing that allows you to create dynamic, context-aware prompts.Template Variables
Your system prompts can include template variables that are automatically filled in during conversations:- Built-in Variables
- Variable Syntax
- Advanced Features
These variables are automatically available in all agent prompts:Example usage:
Prompt Structure
Identity and Role
Identity and Role
Define who the agent is and what they do:
Expertise and Knowledge
Expertise and Knowledge
Specify the agent’s areas of expertise:
Behavior and Personality
Behavior and Personality
Define how the agent should interact:
Constraints and Guidelines
Constraints and Guidelines
Set important limitations and guidelines:
Example Complete Prompt with Template Variables
The template variables (
{{ message }}, {{ gradeLevel? }}, etc.) are automatically filled in when users interact with your agent, making responses more personalized and contextual.Step 4: Model Configuration
- Model Selection
- Parameters
- Memory Settings
Choose the AI model that powers your agent:Claude 3.5 Haiku: Fast, efficient, good for simple tasks
Claude 3.5 Sonnet: Balanced performance and capability
Claude 3 Opus: Most capable, best for complex reasoning
GPT-4: Alternative high-performance option
Step 5: Tool Selection
Choose which tools your agent can access:Essential Tools
Essential Tools
Data Lookup: Access SkillShop’s database of topics, skills, and content
Content Search: Search educational materials and resources
Text Processing: Analyze and transform text content
These tools are recommended for most educational agents.
Specialized Tools
Specialized Tools
Assessment Manager: Create and manage assessments (for assessment-focused agents)
Learning Plan Manager: Create learning plans and modules (for curriculum agents)
Content Discovery: Find external educational content (for content agents)
Calculator: Mathematical operations (for STEM agents)
Google Sheets: Spreadsheet operations (for data-focused agents)
Advanced Tools
Advanced Tools
Code Generator: Generate and analyze code (for programming agents)
Issue Manager: Manage development issues (for technical agents)
Agent Dispatch: Call other agents (for orchestration agents)
Step 6: Testing and Refinement
1
Initial Testing
Test your agent with sample questions and requests to verify it behaves as expected
2
Prompt Refinement
Adjust the system prompt based on testing results - add constraints, clarify behavior, or expand expertise
3
Tool Validation
Verify the agent can effectively use its assigned tools for intended tasks
4
User Testing
Have colleagues or students test the agent and provide feedback
Advanced Agent Features
Tool Choice Configuration
Control how your agent uses tools:- Auto (Recommended)
- Required
- Disabled
- Specific Tool
Let the agent decide when to use tools based on the request
Context and Memory Management
Configure how your agent handles conversation context:- Session Continuity: Maintain context within conversation sessions
- Cross-Session Memory: Remember information across different conversations
- Context Limits: Set maximum context length to manage performance
- Memory Cleanup: Automatically clear sensitive information
Example Custom Agents
STEM Lab Assistant
Special Education Support Agent
Language Arts Writing Coach
Best Practices
Clear Purpose
Define a specific, focused purpose for your agent rather than trying to make it do everything
Consistent Personality
Maintain a consistent voice and approach throughout the system prompt
Safety First
Always include appropriate safety guidelines and constraints for your domain
Iterative Improvement
Continuously test and refine your agent based on real usage and feedback
Managing Custom Agents
Editing Agents
- Prompt Updates: Modify system prompts to improve behavior
- Tool Changes: Add or remove tools based on usage patterns
- Model Upgrades: Switch to newer or more appropriate models
- Configuration Tuning: Adjust temperature and token limits
Sharing Agents
- Public Sharing: Make agents available to your organization
- Export/Import: Share agent configurations with other SkillShop instances
- Version Control: Track changes and maintain agent versions
- Collaboration: Allow team members to contribute to agent development
Performance Monitoring
- Usage Analytics: Track how often and how effectively your agent is used
- Response Quality: Monitor user satisfaction and feedback
- Tool Usage: Analyze which tools are most valuable for your agent
- Cost Management: Monitor token usage and computational costs
Troubleshooting Common Issues
Agent Responses Are Too Generic
Agent Responses Are Too Generic
Solution: Add more specific expertise and constraints to your system prompt. Include domain-specific knowledge and examples. Use template variables like
{{ message }} to make responses more contextual.Agent Doesn't Use Tools Effectively
Agent Doesn't Use Tools Effectively
Solution: Explicitly mention tool usage in the system prompt and provide examples of when to use specific tools.
Agent Behavior Is Inconsistent
Agent Behavior Is Inconsistent
Solution: Lower the temperature setting and add more specific behavioral guidelines to the system prompt.
Agent Responses Are Too Long/Short
Agent Responses Are Too Long/Short
Solution: Adjust max tokens setting and include response length guidelines in the system prompt.
Template Variable Errors
Template Variable Errors
Possible causes:
- Using undefined variables in your prompt
- Incorrect variable syntax
- Missing required variables
- Use built-in variables:
{{ message }},{{ agentName }},{{ userId }},{{ sessionId }} - Check syntax:
{{ variable }}(required),{{ variable? }}(optional) - Test your agent to ensure all variables are properly resolved
Agent Execution Fails
Agent Execution Fails
Possible causes:
- Required template variables are missing
- Invalid template syntax in system prompt
- Referenced documents or prompts don’t exist
- Review system prompt for template variable errors
- Ensure referenced documents exist:
{{ docs/path/file.md }} - Use optional syntax
{{ variable? }}for non-critical variables
Next Steps
1
Plan Your Agent
Identify a specific educational need not met by existing system agents
2
Create and Test
Build your agent using the creation interface and test thoroughly
3
Gather Feedback
Share with colleagues and students to gather improvement suggestions
4
Iterate and Improve
Continuously refine based on usage patterns and feedback
5
Explore Workflows
Consider creating workflow agents that combine your custom agent with others

