[Remote] Financial AI Evaluator (Remote, Hourly Contractor)

Note: The job is a remote job and is open to candidates in USA. CNTXT AI is focused on building artificial intelligence products and data solutions. They are seeking a Financial AI Evaluator to evaluate AI-generated financial content and improve the accuracy and reliability of AI models in handling financial information.

Responsibilities

• Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles
• Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing
• Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records
• Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks
• Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Skills

• Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field
• Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management
• Ability to explain complex financial concepts clearly and accurately in writing
• Full professional English proficiency
• Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow
• Prior experience with AI data training, annotation, or model evaluation
• Familiarity with multimodal AI tools or LLM evaluation workflows

Company Overview