Troubleshooting Guide¶
This guide helps you diagnose and resolve common issues in data-conductor. Find solutions to frequent problems, debugging tips, and when to contact support.
Common troubleshooting scenarios and solutions
Quick Diagnosis¶
System Health Check¶
Before diving into specific issues, check these basics:
✅ System Status Checklist: - [ ] Can you log into data-conductor? - [ ] Are your database integrations showing as connected? - [ ] Can you access the organization settings? - [ ] Are there any error messages in the browser console?
Basic system health verification
Browser Console¶
Many issues can be diagnosed using browser developer tools:
Access Browser Console: - Chrome/Edge: F12 → Console tab - Firefox: F12 → Console tab - Safari: Cmd+Opt+C
Common Console Errors:
401 Unauthorized: Token or session expired
403 Forbidden: Permission denied
404 Not Found: Resource doesn't exist
500 Internal Server Error: Server-side issue
Authentication Issues¶
Cannot Log In¶
Symptoms: - Login page redirects back to login - "Invalid credentials" errors - Account locked messages
Solutions:
1. Check Credentials
Verify:
- Email address is correct
- Password is typed correctly
- Caps Lock is not enabled
- Browser is not auto-filling wrong credentials
2. Clear Browser Data
Clear:
- Cookies for the data-conductor domain
- Local storage
- Session storage
- Browser cache
3. Check IP Restrictions
Verify:
- Your IP is in the trusted IP list
- VPN/proxy isn't changing your IP
- Network firewall allows access
- Organization hasn't restricted access
Step-by-step authentication issue resolution
Session Expires Quickly¶
Symptoms: - Frequent logout prompts - "Session expired" messages - Need to re-login repeatedly
Solutions:
1. Check Session Settings
Review:
- Organization session timeout settings
- Browser security settings
- Third-party cookie blocking
- Browser extensions interfering
2. Network Issues
Check:
- Stable internet connection
- Corporate proxy settings
- Firewall rules
- DNS resolution
Database Connection Issues¶
Integration Connection Failed¶
Symptoms: - "Connection failed" errors - Timeout messages during testing - Unable to execute queries
Diagnosis Steps:
1. Network Connectivity
# Test basic connectivity (if you have command line access)
telnet your-database-host 5432  # PostgreSQL
telnet your-database-host 3306  # MySQL
ping your-database-host
2. Credentials Verification
-- Test with a simple SQL client first
SELECT 1 as test;
3. Firewall and Security
Check:
- Database server firewall rules
- Cloud provider security groups
- VPC/network configuration
- SSL/TLS requirements
Database connection issue diagnosis
Slow Query Performance¶
Symptoms: - Queries taking longer than expected - Timeout errors - System becoming unresponsive
Optimization Steps:
1. Query Analysis
-- Add EXPLAIN to understand query execution
EXPLAIN (ANALYZE, BUFFERS)
SELECT customer_id, COUNT(*)
FROM orders
WHERE order_date >= '{{START_DATE}}'
GROUP BY customer_id;
2. Index Optimization
-- Create indexes on frequently filtered columns
CREATE INDEX idx_orders_date ON orders(order_date);
CREATE INDEX idx_orders_customer ON orders(customer_id);
CREATE INDEX idx_orders_date_customer ON orders(order_date, customer_id);
3. Query Optimization
-- Before: Inefficient query
SELECT * FROM large_table WHERE DATE(created_at) = '2024-01-01';
-- After: Index-friendly query
SELECT * FROM large_table
WHERE created_at >= '2024-01-01'
  AND created_at < '2024-01-02';
Pipeline Execution Issues¶
Data Step Fails to Execute¶
Symptoms: - Error messages in Results tab - "Execution failed" notifications - No results returned
Common Causes and Solutions:
1. SQL Syntax Errors
-- Check for common syntax issues:
- Missing quotes around string variables
- Incorrect variable names
- Database-specific SQL syntax
- Reserved keywords used as column names
2. Variable Issues
Verify:
- Variable names match exactly (case-sensitive)
- Test values are provided
- Variable types are correct
- No special characters causing issues
3. Permission Errors
-- Database user needs proper permissions:
GRANT SELECT ON schema.table_name TO data-conductor_user;
GRANT EXECUTE ON schema.function_name TO data-conductor_user;
Pipeline execution error diagnosis
Variables Not Substituting¶
Symptoms:
- SQL contains literal {{VARIABLE}} text
- "Column doesn't exist" errors
- Unexpected query results
Solutions:
1. Variable Configuration
Check:
- Variable name spelling
- Variable is defined in Variables panel
- Test value is provided
- Variable type is appropriate
2. SQL Syntax
-- Correct variable usage:
WHERE region = '{{REGION}}'        -- String variable
WHERE amount > {{MIN_AMOUNT}}      -- Number variable
WHERE active = {{IS_ACTIVE}}       -- Boolean variable
-- Incorrect usage:
WHERE region = {{REGION}}          -- Missing quotes for string
WHERE amount > '{{MIN_AMOUNT}}'    -- Quotes around number
3. Preview Verification
Steps:
1. Switch to Preview tab
2. Verify variables are replaced
3. Check SQL syntax is correct
4. Test with simple values first
Deployment Issues¶
CRON Deployment Not Running¶
Symptoms: - No executions appearing in Jobs tab - "Next execution" time keeps updating but nothing runs - Deployment shows as active but never executes
Diagnosis Steps:
1. CRON Expression Validation
# Test your CRON expression:
# Use online tools like crontab.guru
0 9 * * *        # Daily at 9 AM - VALID
0 9 * * MON-FRI  # Weekdays at 9 AM - VALID
0 25 * * *       # Invalid hour (25) - INVALID
2. Timezone Issues
Check:
- Organization timezone setting
- Server timezone vs. expected timezone
- Daylight saving time effects
- CRON expression interpretation
3. System Resource Issues
Monitor:
- System CPU and memory usage
- Database connection pool status
- Concurrent execution limits
- Queue backlog
CRON deployment issue resolution
API Endpoint Not Responding¶
Symptoms: - 404 Not Found errors - Authentication failures - Timeout responses
Solutions:
1. Endpoint Verification
# Test API endpoint manually
curl -X POST \
  -H "Authorization: Bearer YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"variable1": "value1"}' \
  https://your-instance.com/api/execute/deployment-id
2. Token Issues
Verify:
- Token is active and not expired
- Token has required permissions
- Authorization header format is correct
- Token is for the correct organization
3. Payload Format
// Correct payload format:
{
  "variables": {
    "START_DATE": "2024-01-01",
    "REGION": "US-West",
    "LIMIT": 100
  }
}
Performance Issues¶
Slow Page Loading¶
Symptoms: - Long delays loading pages - Partial page content loading - Browser becomes unresponsive
Solutions:
1. Browser Optimization
Actions:
- Clear browser cache and cookies
- Disable unnecessary browser extensions
- Update browser to latest version
- Try incognito/private mode
2. Network Optimization
Check:
- Internet connection speed
- Corporate proxy/firewall settings
- VPN performance impact
- DNS resolution speed
3. Data Volume
Optimize:
- Add LIMIT clauses to large queries
- Use pagination for result sets
- Filter data more aggressively
- Consider pre-aggregated views
High Resource Usage¶
Symptoms: - System running slowly - Memory usage alerts - Database connection pool exhaustion
Monitoring:
1. Query Performance
-- Monitor long-running queries
SELECT query, query_start, state, wait_event
FROM pg_stat_activity
WHERE state = 'active'
AND query_start < NOW() - INTERVAL '5 minutes';
2. Resource Usage
Monitor:
- CPU usage during query execution
- Memory consumption patterns
- Database connection count
- Disk I/O patterns
System performance monitoring and optimization
Data Quality Issues¶
Unexpected Results¶
Symptoms: - Wrong data in query results - Missing expected rows - Incorrect calculations
Debugging Steps:
1. Data Validation
-- Check source data quality
SELECT
    COUNT(*) as total_rows,
    COUNT(DISTINCT customer_id) as unique_customers,
    MIN(order_date) as earliest_date,
    MAX(order_date) as latest_date,
    COUNT(CASE WHEN total_amount IS NULL THEN 1 END) as null_amounts
FROM orders
WHERE order_date >= '{{START_DATE}}';
2. Filter Verification
-- Test filters step by step
SELECT COUNT(*) FROM orders;  -- Total count
SELECT COUNT(*) FROM orders WHERE order_date >= '{{START_DATE}}';  -- Date filter
SELECT COUNT(*) FROM orders WHERE order_date >= '{{START_DATE}}' AND region = '{{REGION}}';  -- Combined filters
3. Join Issues
-- Check for data loss in joins
SELECT
    o.customer_id,
    COUNT(o.*) as order_count,
    CASE WHEN c.customer_id IS NULL THEN 'Missing Customer' ELSE 'Found' END as customer_status
FROM orders o
LEFT JOIN customers c ON o.customer_id = c.customer_id
GROUP BY o.customer_id, c.customer_id;
Security and Access Issues¶
Permission Denied Errors¶
Symptoms: - "Access denied" messages - 403 Forbidden errors - Unable to access certain features
Resolution Steps:
1. User Permissions
Check:
- User role (Admin, User, Viewer)
- Organization membership
- Feature-specific permissions
- Recent permission changes
2. IP Restrictions
Verify:
- Current IP is in trusted list
- CIDR ranges are correct
- VPN/proxy IP changes
- Recent IP list modifications
3. Resource Ownership
Confirm:
- User owns the resource
- Resource is shared appropriately
- Organization-level permissions
- Workspace access rights
Security and access issue resolution
IP Access Issues¶
Symptoms: - Blocked access from trusted locations - "IP not authorized" messages - Inconsistent access patterns
Solutions:
1. IP Detection
# Check your current IP
curl ifconfig.me
# Or visit whatismyipaddress.com
2. Network Configuration
Check:
- NAT/proxy changing your IP
- Dynamic IP assignment
- VPN endpoint changes
- Corporate firewall rules
3. CIDR Range Issues
Examples:
192.168.1.100/32  - Single IP
192.168.1.0/24    - Range 192.168.1.1-254
10.0.0.0/8        - Large corporate range
Error Code Reference¶
Common HTTP Status Codes¶
| Code | Meaning | Common Causes | Solutions | 
|---|---|---|---|
| 400 | Bad Request | Invalid JSON, missing parameters | Check request format | 
| 401 | Unauthorized | Invalid/expired token | Refresh authentication | 
| 403 | Forbidden | Insufficient permissions | Check user role/IP | 
| 404 | Not Found | Resource doesn't exist | Verify URL/resource ID | 
| 429 | Too Many Requests | Rate limiting | Reduce request frequency | 
| 500 | Internal Server Error | Server-side issue | Contact support | 
Database Error Codes¶
PostgreSQL:
42601: Syntax error
42703: Column doesn't exist
42P01: Relation doesn't exist
53300: Too many connections
MySQL:
1064: SQL syntax error
1146: Table doesn't exist
1054: Unknown column
1040: Too many connections
Getting Help¶
Self-Service Resources¶
Before Contacting Support: 1. Check this troubleshooting guide 2. Review browser console for errors 3. Test with minimal examples 4. Check system status page 5. Review recent configuration changes
Information to Gather¶
When Reporting Issues: - Exact error messages (copy/paste, not screenshots) - Steps to reproduce the problem - Browser and version you're using - Timestamp when the issue occurred - Your IP address (if relevant) - Recent changes to configuration
Contact Support¶
Support Channels: - Internal Support: Contact your organization administrator - Technical Issues: Include browser console logs - Security Issues: Report immediately with details - Feature Requests: Provide use case and business justification
Emergency Procedures¶
For Critical Issues: 1. Document the impact and affected users 2. Take screenshots of error messages 3. Note exact timestamps of failures 4. Check if issue is organization-wide or user-specific 5. Contact support immediately with all details
Prevention Tips¶
Proactive Monitoring¶
Set Up Alerts For: - Pipeline execution failures - Performance degradation - Security events - Resource usage thresholds
Regular Maintenance¶
Monthly Tasks: - Review audit logs for anomalies - Update and rotate API tokens - Clean up unused data steps and deployments - Performance optimization review
Quarterly Tasks: - Security access review - Disaster recovery testing - Documentation updates - User training refresh
Need more specific help? Check our FAQ or contact your administrator!