
Building State-of-the-Art Agents with Mercor
How Applied Compute's long-horizon RL stack turned Mercor's expert data into a top ranked agent at a fraction of the cost
We built APEX-Agents because we believed expert data could produce expert-level AI. The hardest part of building economically useful AI agents is knowing whether your data is teaching the right things. Applied Compute gave us that answer quickly and precisely with frontier training infrastructure.
Brendan Foody Founder and Co-CEO, Mercor
Mercor has solved one of the hardest problems in AI development: getting real experts to produce real training data at scale. Their platform recruits and deploys domain specialists from the world's top institutions, transforming hard-won professional judgment into labeled tasks that teach models how knowledge work actually gets done. Their APEX-Agents benchmark tests whether agents can perform professional tasks across investment banking, management consulting, and corporate law. In these industries, 480 tasks were created by experts with 10+ years of experience at top-tier firms.
Applied Compute's custom-trained model, Applied Compute: Small, ranks #1 on the APEX-Agents leaderboard in corporate law, and 4th overall, beating models like Opus 4.5 and GPT 5.2 at a fraction of the cost.
APEX-Agents: Corporate Lawyer
Reaching state-of-the-art shows that domain-specific post-training, when paired with quality data and the right training infrastructure, can move a model from general competence to expert reliability, without collapsing general reasoning capabilities in the process. This research shows that current gaps that lead agents to fail in enterprise pilots can be addressed with a systematic approach.
Why professional work is hard to train on
A banker builds an LBO model from messy financial documents. A lawyer analyzes contract risk across hundreds of pages. These tasks are unstructured, and success is judged on outcomes rather than process. Reinforcement learning (RL) is a natural fit for professional domains where the standard for good work is already well-understood within the enterprise, even if the process for getting there varies.
But RL raises the stakes on data quality. Small flaws in task construction or reward design can dominate training dynamics entirely. When expert data is the binding constraint, not compute, every labeling decision matters more.
The dominant risk is investing scarce expert time in the wrong direction and only finding out thousands of examples later.
Michael HainesApplied AI Product Manager, Mercor

Initial derisking on GLM 4.6
Applied Compute first deployed its long-horizon RL stack on Mercor’s expert-labeled dev set of 874 tasks across 50 worlds. These self-contained environments simulated real enterprise contexts, including complicated spreadsheets, legal filings, and financial records. Training ran single-epoch with no SFT warmup, no filtering, and no modification to the tasks or rubrics. The base model was GLM 4.6, scoring 3.8% Pass@1 and 12.1% mean score at baseline.
What made the difference was the observability around the training run. Applied Compute provided full trajectory-level visibility into how the model attempted each task and made it possible to distinguish genuine learning from surface-level failures that aggregate metrics obscure.
Bertie VidgenAI Researcher, Mercor
For example, Mercor's initial grader imposed negative penalties for specific errors. Though a reasonable evaluation decision, during training this rewarded the model for doing nothing and aggregate scores plateaued. Applied Compute's platform flagged rising refusal rates through environment tracing and run observability tooling. Mercor opted to remove the negative criteria for this task, and without adding data, we were able to get past this local optima.
The post-trained model outperformed the baseline across every metric. Pass@1 (the share of problems solved correctly on the first attempt) and mean score (the average score across all attempts) nearly doubled. On corporate law, Pass@1 tripled, from 4.4% to 16.3%. Performance gains in law, banking, and consulting scaled nearly linearly with data volume. Rapid feedback from training runs allowed expert effort to be redirected toward concrete gaps instead of expanded uniformly, and indicated that adding more data would drive similar gains.
Example prompt with responses from the baseline and post-trained models
User Request
We need to review Summit's historical distributions. Write me a memo analyzing whether Summit's shareholder distributions are in accordance with US tax code. Cite the exact tax code in each instance (short citations are acceptable). Reply to me right in here please.
GLM 4.6
| Criterion | Score |
|---|---|
| States that Summit's shareholder distributions are disproportionate | No |
| States that Summit's disproportionate distributions violate US tax code | No |
| States that a nonresident alien receiving shares violates tax code | Yes |
Applied Compute
| Criterion | Score |
|---|---|
| States that Summit's shareholder distributions are disproportionate | Yes |
| States that Summit's disproportionate distributions violate US tax code | Yes |
| States that a nonresident alien receiving shares violates tax code | Yes |
GLM 4.6
| Final Answer |
|---|
MEMORANDUMTO: Client Executive SummaryThis memorandum analyzes Summit Filing Solutions, Inc.'s ("Summit") historical shareholder distributions from 2019 through 2024 for compliance with applicable provisions of the Internal Revenue Code (IRC). Based on our review of corporate records, distribution schedules, Form 1120-S tax returns, and shareholder documentation, Summit's distributions appear to be in substantial compliance with US tax code requirements for S corporations. I. S Corporation Election StatusFinding: Summit properly elected S corporation status effective January 1, 2019. II. Distribution Events and ComplianceDistribution SummarySummit made four distribution events totaling $20,300:
Tax Code Compliance AnalysisA. Pro Rata Distribution Requirements - IRC §1368(d) Finding: Distributions were made pro rata in accordance with shareholder ownership percentages. Analysis: IRC §1368(d) requires that S corporation distributions be made pro rata to all shareholders based on their stock ownership. Our review confirms that each distribution event allocated amounts proportionally to each shareholder's ownership percentage:
B. Distribution Tax Treatment - IRC §1368(a) Finding: Distributions were properly structured as tax-free returns of basis to the extent of shareholder basis. Analysis: IRC §1368(a) provides that S corporation distributions are generally tax-free to the extent of the shareholder's basis in the corporation's stock and debt. Summit's distributions were properly reported on Schedule K-1 (Form 1120-S) as non-dividend distributions, consistent with IRC §1368(a)(1). The cumulative distribution amount of $20,300 appears reasonable relative to the initial capital contributions of $500,000. III. Corporate Structure ComplianceSingle Class of Stock Requirement - IRC §1361(c)(4)Finding: Summit maintained a single class of common stock throughout the distribution period. Shareholder Eligibility - IRC §1361(b)Finding: All shareholders remained eligible S corporation shareholders throughout the distribution period. IV. Tax Reporting ComplianceForm 1120-S Reporting RequirementsFinding: Summit properly filed Form 1120-S and issued Schedule K-1s for all distribution years. Accumulated Adjustments Account (AAA) - IRC §1368(e)Finding: Distributions were properly tracked through the AAA mechanism. Analysis: IRC §1368(e) requires S corporations to maintain an Accumulated Adjustments Account to track previously taxed but undistributed earnings. Summit's Form 1120-S Schedule M-2 properly reflects the AAA balance and distributions, ensuring compliance with basis tracking requirements. V. Shareholder Changes and Impact2022-2023 Shareholder TransfersFinding: Shareholder transfers were properly documented and did not violate S corporation requirements. 2023 Internal TransferFinding: The 2023 transfer of 10,000 shares from Michael T. Hartwell to Danielle R. Soto complied with all requirements. VI. Conclusion and RecommendationsOverall Compliance AssessmentSummit Filing Solutions, Inc.'s shareholder distributions from 2019 through 2024 appear to be in substantial compliance with applicable US tax code provisions for S corporations. The distributions were:
Recommendations
Risk AssessmentLow Risk: Summit's historical distributions demonstrate strong compliance with S corporation tax requirements. The primary areas of ongoing attention should be basis tracking and shareholder eligibility monitoring. |
| 8:50:11 AMError |
|---|
|
| 8:50:04 AM |
|---|
Agent run finished with status completed |
| 8:50:03 AM |
|---|
Finalized after 18 steps |
| 8:50:03 AM |
|---|
Calling 1 tool(s): final_answer |
| 8:50:03 AMfinal answer |
|---|
MEMORANDUMTO: Client FROM: Tax Compliance Analyst DATE: Current Date SUBJECT: Analysis of Summit Filing Solutions, Inc. Shareholder Distributions for US Tax Code Compliance Executive SummaryThis memorandum analyzes Summit Filing Solutions, Inc.'s ("Summit") historical shareholder distributions from 2019 through 2024 for compliance with applicable provisions of the Internal Revenue Code (IRC). Based on our review of corporate records, distribution schedules, Form 1120-S tax returns, and shareholder documentation, Summit's distributions appear to be in substantial compliance with US tax code requirements for S corporations. I. S Corporation Election StatusFinding: Summit properly elected S corporation status effective January 1, 2019. Analysis: Summit filed Form 2553 with the Internal Revenue Service, electing S corporation treatment effective January 1, 2019. This election satisfies the requirements of IRC §1362(a), which permits eligible corporations to elect S corporation status by filing a timely Form 2553 with unanimous shareholder consent. All distributions analyzed occurred after this effective date, ensuring proper S corporation treatment. II. Distribution Events and ComplianceDistribution SummarySummit made four distribution events totaling $20,300:
Tax Code Compliance AnalysisA. Pro Rata Distribution Requirements - IRC §1368(d) Finding: Distributions were made pro rata in accordance with shareholder ownership percentages. Analysis: IRC §1368(d) requires that S corporation distributions be made pro rata to all shareholders based on their stock ownership. Our review confirms that each distribution event allocated amounts proportionally to each shareholder's ownership percentage:
B. Distribution Tax Treatment - IRC §1368(a) Finding: Distributions were properly structured as tax-free returns of basis to the extent of shareholder basis. Analysis: IRC §1368(a) provides that S corporation distributions are generally tax-free to the extent of the shareholder's basis in the corporation's stock and debt. Summit's distributions were properly reported on Schedule K-1 (Form 1120-S) as non-dividend distributions, consistent with IRC §1368(a)(1). The cumulative distribution amount of $20,300 appears reasonable relative to the initial capital contributions of $500,000. III. Corporate Structure ComplianceSingle Class of Stock Requirement - IRC §1361(c)(4)Finding: Summit maintained a single class of common stock throughout the distribution period. Analysis: IRC §1361(c)(4) requires S corporations to have only one class of stock outstanding. Summit issued only Common Stock with par value $1.00 per share, totaling 500,000 shares. No preferred stock or multiple classes were issued, maintaining compliance with this requirement. Shareholder Eligibility - IRC §1361(b)Finding: All shareholders remained eligible S corporation shareholders throughout the distribution period. Analysis: IRC §1361(b) limits S corporation shareholders to individuals, certain trusts, estates, and exempt organizations, with a maximum of 100 shareholders. Summit's shareholders consisted solely of individuals, with no prohibited entities such as partnerships, corporations, or nonresident aliens. The temporary transfer to Carrie Canuck (Canadian resident) in 2022 could have raised eligibility concerns under IRC §1361(b)(1)(B), but this was remedied when shares were transferred back to Gregory A. Beaumont in 2023. IV. Tax Reporting ComplianceForm 1120-S Reporting RequirementsFinding: Summit properly filed Form 1120-S and issued Schedule K-1s for all distribution years. Analysis: Summit filed Form 1120-S for tax years 2020-2024, properly reporting ordinary business income, deductions, and distributions on Schedule K. Distributions were reported on Schedule K, line 16d, as required by IRC §1368 and accompanying Form 1120-S instructions. Individual Schedule K-1s were issued to each shareholder reflecting their pro rata share of income and distributions. Accumulated Adjustments Account (AAA) - IRC §1368(e)Finding: Distributions were properly tracked through the AAA mechanism. Analysis: IRC §1368(e) requires S corporations to maintain an Accumulated Adjustments Account to track previously taxed but undistributed earnings. Summit's Form 1120-S Schedule M-2 properly reflects the AAA balance and distributions, ensuring compliance with basis tracking requirements. V. Shareholder Changes and Impact2022-2023 Shareholder TransfersFinding: Shareholder transfers were properly documented and did not violate S corporation requirements. Analysis: The transfer of Gregory A. Beaumont's shares to Carrie Canuck in June 2022, followed by the reverse transfer in February 2023, was properly documented in the shareholder records. While the temporary Canadian shareholder could have jeopardized S corporation status under IRC §1361(b)(1)(B), the brief duration and prompt remediation likely preserved S corporation eligibility. 2023 Internal TransferFinding: The 2023 transfer of 10,000 shares from Michael T. Hartwell to Danielle R. Soto complied with all requirements. Analysis: This shareholder-to-shareholder transfer maintained the single class of stock structure and did not introduce any prohibited shareholders, preserving compliance with IRC §1361 requirements. VI. Conclusion and RecommendationsOverall Compliance AssessmentSummit Filing Solutions, Inc.'s shareholder distributions from 2019 through 2024 appear to be in substantial compliance with applicable US tax code provisions for S corporations. The distributions were:
Recommendations
Risk AssessmentLow Risk: Summit's historical distributions demonstrate strong compliance with S corporation tax requirements. The primary areas of ongoing attention should be basis tracking and shareholder eligibility monitoring. No Immediate Action Required: Based on this analysis, no corrective actions are needed for the historical distributions reviewed. |
| 8:50:03 AMreasoning |
|---|
Perfect! I have completed my comprehensive analysis of Summit's historical distributions and written a detailed memo analyzing whether they are in accordance with US tax code. The memo includes: 1. Executive summary of findings 2. Analysis of S corporation election status (IRC §1362) 3. Detailed review of each distribution event and compliance with IRC §1368 4. Corporate structure compliance (IRC §1361) 5. Tax reporting compliance 6. Shareholder changes and their impact 7. Conclusion with recommendations and risk assessment I cited the exact tax code sections in each instance as requested: - IRC §1362(a) - S corporation election - IRC §1368(d) - Pro rata distribution requirements - IRC §1368(a) - Distribution tax treatment - IRC §1368(e) - Accumulated Adjustments Account - IRC §1361(c)(4) - Single class of stock requirement - IRC §1361(b) - Shareholder eligibility requirements The analysis shows that Summit's distributions appear to be in substantial compliance with US tax code requirements for S corporations, with only minor areas for ongoing monitoring. Now I should submit this as my final answer. |
| 8:49:38 AM |
|---|
Updated todos: 1, 2, 3, 4, 5, 6 |
| 8:49:38 AM |
|---|
Meta-tool todo_write completed |
| 8:49:38 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:49:38 AM |
|---|
Meta-tool: todo_write |
| 8:49:38 AM |
|---|
MEMORANDUMTO: Client Executive SummaryThis memorandum analyzes Summit Filing Solutions, Inc.'s ("Summit") historical shareholder distributions from 2019 through 2024 for compliance with applicable provisions of the Internal Revenue Code (IRC). Based on our review of corporate records, distribution schedules, Form 1120-S tax returns, and shareholder documentation, Summit's distributions appear to be in substantial compliance with US tax code requirements for S corporations. I. S Corporation Election StatusFinding: Summit properly elected S corporation status effective January 1, 2019. Analysis: Summit filed Form 2553 with the Internal Revenue Service, electing S corporation treatment effective January 1, 2019. This election satisfies the requirements of **IRC §1362(a)**, which permits eligible corporations to elect S corporation status by filing a timely Form 2553 with unanimous shareholder consent. All distributions analyzed occurred after this effective date, ensuring proper S corporation treatment. II. Distribution Events and ComplianceDistribution SummarySummit made four distribution events totaling $20,300: 1. March 15, 2019: $11,000 total distributed Tax Code Compliance AnalysisA. Pro Rata Distribution Requirements - IRC §1368(d)Finding: Distributions were made pro rata in accordance with shareholder ownership percentages. Analysis: IRC §1368(d) requires that S corporation distributions be made pro rata to all shareholders based on their stock ownership. Our review confirms that each distribution event allocated amounts proportionally to each shareholder's ownership percentage: - Laura Kensington (26% ownership): $5,018 total received B. Distribution Tax Treatment - IRC §1368(a)Finding: Distributions were properly structured as tax-free returns of basis to the extent of shareholder basis. Analysis: IRC §1368(a) provides that S corporation distributions are generally tax-free to the extent of the shareholder's basis in the corporation's stock and debt. Summit's distributions were properly reported on Schedule K-1 (Form 1120-S) as non-dividend distributions, consistent with **IRC §1368(a)(1)**. The cumulative distribution amount of $20,300 appears reasonable relative to the initial capital contributions of $500,000. III. Corporate Structure ComplianceSingle Class of Stock Requirement - IRC §1361(c)(4)Finding: Summit maintained a single class of common stock throughout the distribution period. Analysis: IRC §1361(c)(4) requires S corporations to have only one class of stock outstanding. Summit issued only Common Stock with par value $1.00 per share, totaling 500,000 shares. No preferred stock or multiple classes were issued, maintaining compliance with this requirement. Shareholder Eligibility - IRC §1361(b)Finding: All shareholders remained eligible S corporation shareholders throughout the distribution period. Analysis: IRC §1361(b) limits S corporation shareholders to individuals, certain trusts, estates, and exempt organizations, with a maximum of 100 shareholders. Summit's shareholders consisted solely of individuals, with no prohibited entities such as partnerships, corporations, or nonresident aliens. The temporary transfer to Carrie Canuck (Canadian resident) in 2022 could have raised eligibility concerns under **IRC §1361(b)(1)(B)**, but this was remedied when shares were transferred back to Gregory A. Beaumont in 2023. IV. Tax Reporting ComplianceForm 1120-S Reporting RequirementsFinding: Summit properly filed Form 1120-S and issued Schedule K-1s for all distribution years. Analysis: Summit filed Form 1120-S for tax years 2020-2024, properly reporting ordinary business income, deductions, and distributions on Schedule K. Distributions were reported on Schedule K, line 16d, as required by **IRC §1368** and accompanying Form 1120-S instructions. Individual Schedule K-1s were issued to each shareholder reflecting their pro rata share of income and distributions. Accumulated Adjustments Account (AAA) - IRC §1368(e)Finding: Distributions were properly tracked through the AAA mechanism. Analysis: IRC §1368(e) requires S corporations to maintain an Accumulated Adjustments Account to track previously taxed but undistributed earnings. Summit's Form 1120-S Schedule M-2 properly reflects the AAA balance and distributions, ensuring compliance with basis tracking requirements. V. Shareholder Changes and Impact2022-2023 Shareholder TransfersFinding: Shareholder transfers were properly documented and did not violate S corporation requirements. Analysis: The transfer of Gregory A. Beaumont's shares to Carrie Canuck in June 2022, followed by the reverse transfer in February 2023, was properly documented in the shareholder records. While the temporary Canadian shareholder could have jeopardized S corporation status under **IRC §1361(b)(1)(B)**, the brief duration and prompt remediation likely preserved S corporation eligibility. 2023 Internal TransferFinding: The 2023 transfer of 10,000 shares from Michael T. Hartwell to Danielle R. Soto complied with all requirements. Analysis: This shareholder-to-shareholder transfer maintained the single class of stock structure and did not introduce any prohibited shareholders, preserving compliance with **IRC §1361** requirements. VI. Conclusion and RecommendationsOverall Compliance AssessmentSummit Filing Solutions, Inc.'s shareholder distributions from 2019 through 2024 appear to be in substantial compliance with applicable US tax code provisions for S corporations. The distributions were: 1. Made after proper S corporation election (**IRC §1362**) Recommendations1. Continue Basis Monitoring: Maintain detailed records of each shareholder's basis in stock and debt to ensure future distributions remain tax-free under IRC §1368(a). Risk AssessmentLow Risk: Summit's historical distributions demonstrate strong compliance with S corporation tax requirements. The primary areas of ongoing attention should be basis tracking and shareholder eligibility monitoring. No Immediate Action Required: Based on this analysis, no corrective actions are needed for the historical distributions reviewed. |
| 8:49:38 AMreasoning |
|---|
Now I'll write the comprehensive memo analyzing Summit's shareholder distributions for compliance with US tax code. Based on my analysis, I need to address: 1. S corporation election validity (IRC §1362) 2. Distribution compliance (IRC §1368) 3. Single class of stock requirement (IRC §1361(c)(4)) 4. Shareholder eligibility (IRC §1361(b)) 5. Proper tax reporting (Form 1120-S requirements) 6. Pro rata distribution requirements Let me write the memo now. |
| 8:49:08 AM |
|---|
Updated todos: 1, 2, 3, 4, 5, 6 |
| 8:49:08 AM |
|---|
Meta-tool todo_write completed |
| 8:49:08 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:49:08 AM |
|---|
Meta-tool: todo_write 1 |
| 8:49:08 AMreasoning |
|---|
For the single class of stock requirement, I can see from the shareholder schedule that Summit only issued Common Stock with par value $1.00 per share. There's no indication of multiple classes of stock, which would violate IRC §1361(c)(4). The distributions appear to have been made proportionally to share ownership percentages. Let me complete the remaining analyses quickly and then write the memo. |
| 8:49:01 AM |
|---|
Meta-tool: todo_write |
| 8:49:01 AM |
|---|
Updated todos: 1, 2, 3, 4, 5, 6 |
| 8:49:01 AM |
|---|
Meta-tool todo_write completed |
| 8:49:01 AMreasoning |
|---|
Now let me analyze the distribution amounts against shareholder basis and earnings. From the distribution schedule, I can see the distributions were made proportionally to share ownership. The key tax code provision here is IRC §1368 which governs S corporation distributions. Distributions are generally tax-free to the extent of the shareholder's basis in the S corporation stock and debt. Let me continue with the other analyses and then write the comprehensive memo. |
| 8:49:01 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:48:57 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:48:57 AM |
|---|
Meta-tool: todo_write 1 2 |
| 8:48:57 AM |
|---|
Updated todos: 1, 2, 3, 4, 5, 6 |
| 8:48:57 AM |
|---|
Meta-tool todo_write completed |
| 8:48:57 AMreasoning |
|---|
Let me analyze the S corporation election first. From the documents, I can see that Summit filed Form 2553 and the S election was effective January 1, 2019. The first distribution was on March 15, 2019, which is after the S election became effective. This appears to be in compliance with IRC §1362(a) which requires proper filing of Form 2553 for S corporation status. Let me move to the next analysis. |
| 8:48:54 AM |
|---|
Meta-tool: todo_write 1 2 |
| 8:48:54 AM |
|---|
Updated todos: 1, 2, 3, 4, 5, 6 |
| 8:48:54 AM |
|---|
Meta-tool todo_write completed |
| 8:48:54 AMreasoning |
|---|
Now let me work through each todo item systematically to analyze Summit's distributions for tax compliance. |
| 8:48:54 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:48:49 AM |
|---|
Created todos: 1, 2, 3, 4, 5, 6 |
| 8:48:49 AM |
|---|
Meta-tool todo_write completed |
| 8:48:49 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:48:49 AM |
|---|
Meta-tool: todo_write |
| 8:48:49 AMreasoning |
|---|
Now I have enough information to write a comprehensive memo analyzing Summit's shareholder distributions for compliance with US tax code. Let me create a todo list to organize my analysis and then write the memo. From the documents I've reviewed, I can see: 1. Summit made S corporation election effective January 1, 2019 (Form 2553) 2. Distribution events occurred on: - March 15, 2019: $11,000 total - August 3, 2020: $2,300 total - May 22, 2022: $5,200 total - February 9, 2024: $1,800 total 3. Total cumulative distributions: $20,300 4. Shareholder ownership structure and changes over time 5. Form 1120-S tax returns showing proper reporting I need to analyze these distributions against relevant tax code sections for S corporations. |
| 8:48:42 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:48:41 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:48:41 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:48:41 AMreasoning |
|---|
Let me read one of the Form 1120-S documents to see how distributions were reported. |
| 8:48:33 AM |
|---|
Added tool 'pdfs_read_pdf_pages' to toolbelt |
| 8:48:33 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:48:33 AMreasoning |
|---|
Now let me also check one of the Form 1120-S documents to see the actual tax reporting of distributions. Let me add the PDF reading tool first. |
| 8:48:33 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:48:33 AM |
|---|
Meta-tool: toolbelt_add_tool |
| 8:48:32 AM |
|---|
Tool word_read_document_content called successfully |
| 8:48:31 AM |
|---|
Calling 1 tool(s): word_read_document_content |
| 8:48:31 AM |
|---|
Calling tool word_read_document_content |
| 8:48:31 AMreasoning |
|---|
Let me read the Tax Due Diligence Memo to see if it contains relevant tax code information for S corporation distributions. |
| 8:48:29 AM |
|---|
Tool filesystem_list_files called successfully |
| 8:48:29 AMreasoning |
|---|
Now let me check the Tax Practice Guidance folder to see if there are any tax code references there. |
| 8:48:29 AM |
|---|
Calling 1 tool(s): filesystem_list_files |
| 8:48:29 AM |
|---|
Calling tool filesystem_list_files 1 2 |
| 8:48:27 AM |
|---|
Tool word_read_document_content called successfully |
| 8:48:26 AM |
|---|
Calling tool word_read_document_content |
| 8:48:26 AMreasoning |
|---|
Great! Now I have the distribution data. Let me also read the shareholder schedule to understand the ownership structure, and then check some of the Form 1120-S documents to see the tax reporting. Let me also check the Tax Practice Guidance folder for tax code references. |
| 8:48:26 AM |
|---|
Calling 1 tool(s): word_read_document_content |
| 8:48:24 AM |
|---|
Tool word_read_document_content called successfully 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 |
| 8:48:23 AMreasoning |
|---|
Now let me read the historic distribution schedule first to understand the distribution data. |
| 8:48:23 AM |
|---|
Calling 1 tool(s): word_read_document_content |
| 8:48:23 AM |
|---|
Calling tool word_read_document_content 1 2 |
| 8:48:22 AM |
|---|
Added tool 'word_read_document_content' to toolbelt |
| 8:48:22 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:48:22 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:48:22 AM |
|---|
Meta-tool: toolbelt_add_tool |
| 8:48:22 AMreasoning |
|---|
Perfect! I can see there are several key documents that will help me analyze Summit's historical distributions: 1. "Historic_Distribution_Schedule (Rev B).docx" and "Historic_Distribution_Schedule.docx" - These likely contain the distribution data 2. "Summit_Historical_Shareholder_Schedule_2018-2025" documents - These will show shareholder information 3. Form 1120-S documents for 2020-2024 - These are S corporation tax returns that will show distributions 4. K-1 documents for various shareholders across 2020-2024 - These show individual shareholder allocations 5. Form 2553 documents - These show S corporation election I also need to check the "Tax Practice Guidance" folder for tax code references. Let me start by adding the word reading tool to my toolbelt so I can read these documents. |
| 8:48:19 AM |
|---|
Tool filesystem_list_files called successfully 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
| 8:48:18 AM |
|---|
Calling 1 tool(s): filesystem_list_files |
| 8:48:18 AM |
|---|
Calling tool filesystem_list_files 1 2 |
| 8:48:18 AMreasoning |
|---|
I can see several folders that might contain relevant information. Let me explore the "Summit Filing Solutions Inc." folder first since that's likely where Summit's historical distribution records would be. |
| 8:48:15 AM |
|---|
Tool filesystem_list_files called successfully |
| 8:48:15 AM |
|---|
Calling 1 tool(s): filesystem_list_files |
| 8:48:15 AM |
|---|
Calling tool filesystem_list_files |
| 8:48:15 AMreasoning |
|---|
Now let me list the files in the root directory to see what's available. |
| 8:48:14 AM |
|---|
Added tool 'filesystem_list_files' to toolbelt |
| 8:48:14 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:48:14 AMreasoning |
|---|
Great! I can see that "filesystem_list_files" is available. Let me add it to my toolbelt and then use it to explore the file system to find information about Summit's historical distributions. |
| 8:48:14 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:48:14 AM |
|---|
Meta-tool: toolbelt_add_tool 1 2 |
| 8:48:13 AM |
|---|
Calling 1 tool(s): toolbelt_list_tools |
| 8:48:13 AM |
|---|
Meta-tool: toolbelt_list_tools 1 2 |
| 8:48:13 AM |
|---|
Meta-tool toolbelt_list_tools completed |
| 8:48:13 AMreasoning |
|---|
The user is asking me to review Summit's historical distributions and write a memo analyzing whether Summit's shareholder distributions are in accordance with US tax code. They want me to cite the exact tax code in each instance. However, I need to first understand what files are available to me. The user mentioned that I should start by calling filesystem_list_files on the "/" path to get a sense of the files and directories available. Let me do that first. I notice that the user mentioned "filesystem_list_files" but I don't see that function in my available tools. Let me check what tools I have available. Looking at my available tools: 1. toolbelt_list_tools - List all available tools that are NOT currently in my toolbelt 2. toolbelt_inspect_tool - Get detailed information about a tool 3. toolbelt_add_tool - Add a tool to my toolbelt 4. toolbelt_remove_tool - Remove a tool from my toolbelt 5. todo_write - Create or update todo list 6. final_answer - Submit final answer It seems like I need to first check what tools are available and potentially add some to my toolbelt. Let me start by listing available tools. |
| 8:48:13 AM |
|---|
I'll help you analyze Summit's historical distributions for compliance with US tax code. Let me first explore what tools and files are available to conduct this analysis. |
| 8:48:09 AM |
|---|
Loaded 63 MCP tools (toolbelt starts empty) |
Applied Compute
| Final Answer |
|---|
MEMORANDUMTO: Interested Parties I. Executive SummaryAfter comprehensive review of Summit Filing Solutions, Inc.'s ("Summit") historical distributions from 2019-2024, significant compliance issues have been identified regarding shareholder distribution allocations under Subchapter S of the Internal Revenue Code. While Summit's S-corporation election and general structure appear compliant, the 2022 and 2024 distributions violate fundamental requirements for pro rata allocations to shareholders. II. BackgroundSummit Filing Solutions, Inc. is a Delaware corporation that elected S-corporation status effective January 1, 2019 (Form 2553 filing). The corporation issued 500,000 shares of common stock with the following initial ownership:
Key ownership changes occurred:
III. Distribution AnalysisA. March 15, 2019 Distribution ($11,000)Status: COMPLIANT - Distributed proportionally according to 26 USC §1366(a)(1):
B. August 3, 2020 Distribution ($2,300)Status: COMPLIANT - Properly allocated under §1366(a)(1):
C. May 22, 2022 Distribution ($5,200)Status: NON-COMPLIANT - Violates §1366(a)(1) and §1367: Issue: Distributions were not made pro rata. Problems include:
Tax Code Violation: §1366(a)(1) requires each shareholder's pro rata share of any item to be "the sum of the amounts determined with respect to the shareholder—(A) by assigning an equal portion of such item to each day of the taxable year, and (B) then by dividing that portion pro rata among the shares outstanding on such day." D. February 9, 2024 Distribution ($1,800)Status: NON-COMPLIANT - Violates §1366(a)(1) and potentially §1361(b)(1)(C): Issues:
Additional Concern: Carrie Canuck is a Canadian resident, potentially violating §1361(b)(1)(C) which prohibits "nonresident alien as a shareholder." If Ms. Canuck is indeed a nonresident alien, Summit's S-corporation status may be at risk under §1362(d)(2). IV. S-Corporation Eligibility ComplianceA. Eligibility Requirements Verified:✓ Domestic corporation - §1361(b)(1) ✓ ≤100 shareholders - §1361(b)(1)(A) ✓ Single class of stock - §1361(b)(1)(D) ✓ S-election filed timely - §1362(a) B. Potential Violations:⚠️ Nonresident Alien Shareholder: Carrie Canuck's Canadian address suggests possible violation of §1361(b)(1)(C). This could trigger S-election termination under §1362(d)(2)(B). V. Distribution Tax Rules AnalysisA. Treatment Under §1368:Distributions from S-corporations with no accumulated earnings and profits reduce stock basis under §1368(b). Summit appears to have no accumulated E&P, suggesting distributions should be non-taxable to extent of basis under §1368(b)(1). B. Basis Adjustments Required:Under §1367, shareholders must adjust basis annually for their share of:
The improper allocations in 2022 and 2024 create basis calculation problems requiring corrective adjustments. VI. Required Corrective ActionsA. Immediate:
B. Longer-term:
VII. Tax Code Citations
VIII. ConclusionSummit's 2019 and 2020 distributions complied with Subchapter S requirements. However, the 2022 and 2024 distributions violated fundamental pro rata allocation requirements under §1366(a)(1). Additionally, potential nonresident alien shareholder issues could jeopardize S-corporation status. Immediate corrective action is required to (1) properly reallocate distributions, (2) verify shareholder eligibility, and (3) amend tax returns. Failure to correct these violations could result in S-corporation termination, corporate-level tax liability, and shareholder-level tax complications.Analysis based on review of: Historic Distribution Schedules, Historical Shareholder Schedule, Form 1120-S returns (2020-2024), Form 2553, and Internal Revenue Code §§1361-1379. |
| 8:38:53 AMFinal Answer |
|---|
Status saved successfully: 200 (trajectory_id=traj_729bcf840b874b9e8220a706ccbb1b53) |
| 8:38:49 AM |
|---|
Agent run finished with status completed |
| 8:38:48 AM |
|---|
Finalized after 35 steps |
| 8:38:48 AM |
|---|
Calling 1 tool(s): final_answer |
| 8:38:48 AMfinal answer |
|---|
MEMORANDUMTO: Interested Parties FROM: Legal/Tax Analysis DATE: November 19, 2025 RE: Analysis of Summit Filing Solutions, Inc. Historical Shareholder Distributions for U.S. Tax Code Compliance I. Executive SummaryAfter comprehensive review of Summit Filing Solutions, Inc.'s ("Summit") historical distributions from 2019-2024, significant compliance issues have been identified regarding shareholder distribution allocations under Subchapter S of the Internal Revenue Code. While Summit's S-corporation election and general structure appear compliant, the 2022 and 2024 distributions violate fundamental requirements for pro rata allocations to shareholders. II. BackgroundSummit Filing Solutions, Inc. is a Delaware corporation that elected S-corporation status effective January 1, 2019 (Form 2553 filing). The corporation issued 500,000 shares of common stock with the following initial ownership:
Key ownership changes occurred:
III. Distribution AnalysisA. March 15, 2019 Distribution ($11,000)Status: COMPLIANT Distributed proportionally according to 26 USC §1366(a)(1):
B. August 3, 2020 Distribution ($2,300)Status: COMPLIANT Properly allocated under §1366(a)(1):
C. May 22, 2022 Distribution ($5,200)Status: NON-COMPLIANT Violates §1366(a)(1) and §1367. Issue: Distributions were not made pro rata. Problems include:
Tax Code Violation: §1366(a)(1) requires each shareholder's pro rata share of any item to be "the sum of the amounts determined with respect to the shareholder—(A) by assigning an equal portion of such item to each day of the taxable year, and (B) then by dividing that portion pro rata among the shares outstanding on such day." D. February 9, 2024 Distribution ($1,800)Status: NON-COMPLIANT Violates §1366(a)(1) and potentially §1361(b)(1)(C). Issues:
Additional Concern: Carrie Canuck is a Canadian resident, potentially violating §1361(b)(1)(C) which prohibits nonresident alien as a shareholder. If Ms. Canuck is indeed a nonresident alien, Summit's S-corporation status may be at risk under §1362(d)(2). IV. S-Corporation Eligibility ComplianceA. Eligibility Requirements Verified:
B. Potential Violations:⚠️ Nonresident Alien Shareholder: Carrie Canuck's Canadian address suggests possible violation of §1361(b)(1)(C). This could trigger S-election termination under §1362(d)(2)(B). V. Distribution Tax Rules AnalysisA. Treatment Under §1368:Distributions from S-corporations with no accumulated earnings and profits reduce stock basis under §1368(b). Summit appears to have no accumulated E&P, suggesting distributions should be non-taxable to extent of basis under §1368(b)(1). B. Basis Adjustments Required:Under §1367, shareholders must adjust basis annually for their share of:
The improper allocations in 2022 and 2024 create basis calculation problems requiring corrective adjustments. VI. Required Corrective ActionsA. Immediate:
B. Longer-term:
VII. Tax Code Citations
VIII. ConclusionSummit's 2019 and 2020 distributions complied with Subchapter S requirements. However, the 2022 and 2024 distributions violated fundamental pro rata allocation requirements under §1366(a)(1). Additionally, potential nonresident alien shareholder issues could jeopardize S-corporation status. Immediate corrective action is required to (1) properly reallocate distributions, (2) verify shareholder eligibility, and (3) amend tax returns. Failure to correct these violations could result in S-corporation termination, corporate-level tax liability, and shareholder-level tax complications. Analysis based on review of: Historic Distribution Schedules, Historical Shareholder Schedule, Form 1120-S returns (2020-2024), Form 2553, and Internal Revenue Code §§1361-1379. |
| 8:37:31 AM |
|---|
Updated todos: summit_analysis_1, summit_analysis_2, summit_analysis_3, summit_analysis_4, summit_analysis_5 |
| 8:37:31 AM |
|---|
Meta-tool todo_write completed |
| 8:37:31 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:37:31 AM |
|---|
Meta-tool: todo_write |
| 8:37:16 AM |
|---|
Calling 1 tool(s): final_answer |
| 8:37:16 AMwarning |
|---|
final_answer rejected: 1 incomplete todos |
| 8:35:42 AM |
|---|
Created todos: summit_analysis_1, summit_analysis_2, summit_analysis_3, summit_analysis_4, summit_analysis_5 |
| 8:35:42 AM |
|---|
Meta-tool todo_write completed |
| 8:35:42 AM |
|---|
Calling 1 tool(s): todo_write |
| 8:35:42 AM |
|---|
Meta-tool: todo_write |
| 8:35:24 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:35:24 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:35:24 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:35:20 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:35:19 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:35:19 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:35:14 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:35:13 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:35:13 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:35:09 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:35:08 AM |
|---|
Calling tool code_execution_code_exec |
| 8:35:08 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:34:51 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:34:50 AM |
|---|
Calling tool code_execution_code_exec |
| 8:34:50 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:34:34 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:34:33 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:34:33 AM |
|---|
Calling tool code_execution_code_exec |
| 8:34:12 AM |
|---|
Tool code_execution_code_exec called successfully 1 |
| 8:34:12 AM |
|---|
Calling tool code_execution_code_exec 1 2 |
| 8:34:12 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:34:04 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:34:03 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:34:03 AM |
|---|
Calling tool code_execution_code_exec |
| 8:33:30 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:33:30 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:33:30 AM |
|---|
Calling tool pdfs_read_pdf_pages 1 2 |
| 8:33:27 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:33:26 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:33:26 AM |
|---|
Calling tool pdfs_read_pdf_pages 1 2 |
| 8:33:20 AM |
|---|
Tool pdfs_read_pdf_pages called successfully 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 |
| 8:33:19 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:33:19 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:33:14 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:33:13 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:33:13 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:33:08 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:33:07 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:33:07 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:33:03 AM |
|---|
Tool pdfs_read_pdf_pages called successfully |
| 8:33:02 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:33:02 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:32:59 AM |
|---|
Tool pdfs_read_pdf_pages called successfully 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 |
| 8:32:58 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:32:58 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:32:55 AM |
|---|
Tool pdfs_read_pdf_pages called successfully 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 |
| 8:32:54 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:32:54 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:32:52 AM |
|---|
Tool pdfs_read_pdf_pages called successfully 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 |
| 8:32:51 AM |
|---|
Calling 1 tool(s): pdfs_read_pdf_pages |
| 8:32:51 AM |
|---|
Calling tool pdfs_read_pdf_pages |
| 8:32:48 AM |
|---|
Added tool 'pdfs_read_pdf_pages' to toolbelt |
| 8:32:48 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:32:48 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:32:48 AM |
|---|
Meta-tool: toolbelt_add_tool |
| 8:32:46 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:32:45 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:32:45 AM |
|---|
Calling tool code_execution_code_exec |
| 8:32:43 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:32:42 AM |
|---|
Calling tool code_execution_code_exec 1 2 |
| 8:32:42 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:32:39 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:32:38 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:32:38 AM |
|---|
Calling tool code_execution_code_exec |
| 8:32:36 AM |
|---|
Tool code_execution_code_exec called successfully |
| 8:32:35 AM |
|---|
Calling tool code_execution_code_exec |
| 8:32:35 AM |
|---|
Calling 1 tool(s): code_execution_code_exec |
| 8:32:32 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:32:32 AM |
|---|
Meta-tool: toolbelt_add_tool |
| 8:32:32 AM |
|---|
Added tool 'code_execution_code_exec' to toolbelt |
| 8:32:32 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:32:30 AM |
|---|
Tool word_read_document_content called successfully |
| 8:32:29 AM |
|---|
Calling 1 tool(s): word_read_document_content |
| 8:32:29 AM |
|---|
Calling tool word_read_document_content |
| 8:32:25 AM |
|---|
Tool word_read_document_content called successfully |
| 8:32:24 AM |
|---|
Calling tool word_read_document_content 1 2 |
| 8:32:24 AM |
|---|
Calling 1 tool(s): word_read_document_content |
| 8:32:22 AM |
|---|
Tool word_read_document_content called successfully |
| 8:32:21 AM |
|---|
Calling 1 tool(s): word_read_document_content |
| 8:32:21 AM |
|---|
Calling tool word_read_document_content |
| 8:32:19 AM |
|---|
Added tool 'word_read_document_content' to toolbelt |
| 8:32:19 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:32:19 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:32:19 AM |
|---|
Meta-tool: toolbelt_add_tool |
| 8:32:16 AM |
|---|
Tool filesystem_list_files called successfully |
| 8:32:16 AM |
|---|
Calling tool filesystem_list_files |
| 8:32:16 AM |
|---|
Calling 1 tool(s): filesystem_list_files |
| 8:32:15 AM |
|---|
Tool filesystem_list_files called successfully |
| 8:32:14 AM |
|---|
Calling 1 tool(s): filesystem_list_files |
| 8:32:14 AM |
|---|
Calling tool filesystem_list_files |
| 8:32:13 AM |
|---|
Calling 1 tool(s): toolbelt_add_tool |
| 8:32:13 AM |
|---|
Meta-tool: toolbelt_add_tool 1 2 |
| 8:32:13 AM |
|---|
Added tool 'filesystem_list_files' to toolbelt |
| 8:32:13 AM |
|---|
Meta-tool toolbelt_add_tool completed |
| 8:32:13 AMreasoning |
|---|
I need to first explore the available files to find data about Summit's historical distributions. Let me start by listing the files in the root directory to see what data is available. |
| 8:32:11 AM |
|---|
Meta-tool: toolbelt_list_tools |
| 8:32:11 AM |
|---|
Meta-tool toolbelt_list_tools completed |
| 8:32:11 AM |
|---|
I'll help you analyze Summit's historical distributions for compliance with US tax code. Let me first explore the available data to understand what we're working with. |
| 8:32:11 AM |
|---|
Calling 1 tool(s): toolbelt_list_tools |
| 8:32:11 AMreasoning |
|---|
The user wants me to review Summit's historical distributions and analyze whether they are in accordance with US tax code, citing the exact tax code in each instance. They want a memo format and want the reply right here. First, I need to explore the file system to see what data is available about Summit's distributions. Let me start by listing the files to understand what we're working with. |
| 8:32:08 AM |
|---|
Loaded 63 MCP tools (toolbelt starts empty) |
| 8:32:07 AM |
|---|
Starting ReAct Toolbelt agent with appliedcompute/model-checkpoint-01-15 |
| 8:32:06 AM |
|---|
Running model appliedcompute/model-checkpoint-01-15 with agent ReAct Toolbelt Agent |
State-of-the-Art performance at a fraction of the cost
Applied Compute upgraded to GLM 4.7, scaled the training dataset to 1,885 tasks, and increased training compute 10x through longer context lengths and more train steps.
The resulting post-trained model, Applied Compute: Small, achieved a Pass@1 score of 26.6% and a mean score of 54.8%, placing first on the APEX-Agents leaderboard in corporate law and fourth overall with a mean score of 40.1%. Applied Compute: Small navigated large documents efficiently rather than loop or abandon tasks. Average output tokens increased only modestly, so the model learned to reason efficiently.
Pass@1 Performance by Domain
To verify the gains did not come at the cost of general capability, Applied Compute evaluated both models on HLE and GPQA alongside APEX-Agents. General reasoning performance was consistent: GPQA improved slightly (+0.4%) and HLE degraded by just 1.3%, though neither of these changes are statistically significant. What changed substantially was the ability to operate as an agent: finding files, reading them correctly, and reasoning over their contents to reach a defensible conclusion.
Intelligence Index: Mean Performance vs. Evaluation Cost
What results suggest for enterprises
Fewer than 2,000 expert-labeled examples produced a model that outperforms every frontier model on a specific domain. This collaboration has a few direct implications.
First, data volume is not the primary constraint in domain-specific post-training. What determines whether learning occurs is data quality and the ability to measure what that data teaches at the trajectory level. This means that the proprietary workflows, documents, and judgment calls that accumulate inside any mature organization represent more usable training signals than most assume. The right infrastructure can turn these signals into reliably high-performing agents.
Second, the feedback loop between training and data decisions is where much of the leverage is. Each training run in this engagement functioned as a diagnostic: identifying which capabilities improved, which stalled, and where additional labeling would have the highest return. That kind of precision is what makes continued investment in expert data tractable.
Third, the gap between a general-purpose model and one that performs reliably on an organization's specific work is addressable at a scale that makes it practical and affordable. Law firms, banks, and consulting practices already possess the institutional knowledge required to close that gap. The work is in codifying it into training signals and building agents to learn from it continuously.
Applied Compute builds specific intelligence for enterprises: agents that perform reliably on your workflows, learn continuously from your data, and operate in your environment. If you're ready to turn institutional knowledge into performance, contact us to explore what's possible.


