--- title: "Real Talk: AI Without Context Is Just Expensive Guesswork" description: AI and context; Treat AI as a collaboration rather than the answer to all. --- [![CCNY](https://blog.ccnyinc.org/hs-fs/hubfs/raw_assets/public/CCNY_Sep2021/images/header_logo.png?width=1008&height=900&name=header_logo.png "CCNY")](https://ccnyinc.org/) - [Register For Training](http://ccnyinc.org/training-reg-form) - [Home](https://ccnyinc.org/) - Our Story - [Our Story](https://ccnyinc.org/our-story/) - [Our Team](https://ccnyinc.org/about-us/) - [Case Studies](https://ccnyinc.org/case-studies/) - Service Toolkits - [Data Collection Toolkit](https://ccnyinc.org/data-collection-toolkit/) - [Data Analysis Toolkit](https://ccnyinc.org/data-analysis-toolkit/) - [Program Evaluation Toolkit](https://ccnyinc.org/program-evaluation-toolkit/) - [Performance Enhancement Toolkit](https://ccnyinc.org/performance-enhancement-toolkit/) - [Specialized Training](https://ccnyinc.org/specialized-training-2/) - [Management Services](https://ccnyinc.org/management-services/) - Project Portal - [Project Portal](https://ccnyinc.org/project-portal/) - [IT Resources](https://ccnyinc.org/teamviewer-remote/) - [High Fidelity Wraparound](https://ccnyinc.org/high-fidelity-wraparound/) - [STEM 2035](https://www.stem2035.org/) - [PEDALS](https://pedalsprogram.org/) - [AROUNJA](http://arounja.com/) - [News](https://ccnyinc.org/news/) [Work With CCNY](http://ccnyinc.org/#work-with-pie) - [Register For Training](http://ccnyinc.org/training-reg-form) - [Home](https://ccnyinc.org/) - [Our Story](https://ccnyinc.org/our-story/) - [Our Team](https://ccnyinc.org/about-us/) - [Case Studies](https://ccnyinc.org/case-studies/) - [Data Collection Toolkit](https://ccnyinc.org/data-collection-toolkit/) - [Data Analysis Toolkit](https://ccnyinc.org/data-analysis-toolkit/) - [Program Evaluation Toolkit](https://ccnyinc.org/program-evaluation-toolkit/) - [Performance Enhancement Toolkit](https://ccnyinc.org/performance-enhancement-toolkit/) - [Specialized Training](https://ccnyinc.org/specialized-training-2/) - [Management Services](https://ccnyinc.org/management-services/) - [Project Portal](https://ccnyinc.org/project-portal/) - [IT Resources](https://ccnyinc.org/teamviewer-remote/) - [High Fidelity Wraparound](https://ccnyinc.org/high-fidelity-wraparound/) - [STEM 2035](https://www.stem2035.org/) - [PEDALS](https://pedalsprogram.org/) - [AROUNJA](http://arounja.com/) - [News](https://ccnyinc.org/news/) - [Work With CCNY](http://ccnyinc.org/#work-with-pie) # Real Talk: AI Without Context Is Just Expensive Guesswork by [Anna Loewer](https://blog.ccnyinc.org/blog/author/anna-loewer) | Sep 4, 2025 | [AI](https://blog.ccnyinc.org/blog/tag/ai) | [0 Comments](https://blog.ccnyinc.org/blog/real-talk-ai-without-context-is-just-expensive-guesswork#comments-listing) A managed care organization spent over a year and millions of dollars on an AI tool that didn't work. Their team was frustrated, leadership questioned every investment, and despite sophisticated technology and abundant data, something crucial was missing: *context*. We live in a time where AI promises to solve everything—from predicting customer behavior to diagnosing rare diseases. Yet for every success story in tech headlines, there's a quieter reality: organizations are investing heavily in AI solutions that simply don't deliver.   **The Problem: AI Doesn't Know Your World** "There's usually an expectation that AI is going to fill in the gaps in terms of context," explains David Monroe, CCNY's Director of Business Development. "The idea that it would understand your clinical practice, your evidence-based practices, and how you've configured those practices to your population. However, those things come from the people who do the work."   This touches on a fundamental misunderstanding about how AI operates. While large language models are trained on vast amounts of information, they lack a nuanced understanding of your specific environment, constraints, and objectives.   Think of it like having access to the world's most extensive library, but not knowing which books are relevant to your particular challenge. AI might connect economics to your social media strategy, but what you really need is insight into community-level factors that affect youth outcomes.   Context isn't just about being more specific in your prompts—it's about providing the environmental framework that shapes how information should be interpreted and applied.   For this managed care organization, context meant understanding several key factors: - They operated in the nonprofit space, where success is not only measured by profit margins, but also by impact on lives and communities - The political and funding landscapes that shaped their decision-making processes - The specific demographics, geographic factors, and social determinants affecting the communities they served **The Solution: Collaborative Intelligence** Working with CCNY, they took a different approach. We chose supervised learning to maintain visibility into how conclusions were reached. Over nine months, we developed predictive analytics covering more than 350,000 covered lives, but more importantly, we involved the client throughout the iterative process.   The breakthrough came not from the final algorithm, but from the collaborative approach. Rather than delivering a black box solution, we worked alongside their team, sharing analysis and incorporating their expertise at each step. When they received the final predictive model, they understood not just what it could do—but how it worked and what the limitations were.   **The Results** The organization could now: - Identify youth at high risk of out-of-home placement before crises occurred - Pinpoint protective factors that could help keep children safe in their communities - Spot disproportional outcomes across different populations and quantify existing inequities - Target community-level interventions based on drivers like poverty and social determinants of health One particularly human insight emerged from the data: for families supporting children with developmental disabilities, respite care was crucial—but it didn't matter when or how it was delivered. Weekends, weeknights, summer programs—the specific timing mattered less than simply giving families a break from challenging circumstances.   This insight felt deeply human and actionable. It gave the organization hope and concrete direction for program development.   **The Key Takeaway for Your Organization** Perhaps most importantly, effective AI implementation requires what researchers refer to as "the human in the loop." AI should function as collaborative intelligence, not autonomous decision-making.   Success comes from treating AI as a sophisticated intern rather than an expert consultant. You bring the context, domain knowledge, and environmental understanding; AI brings processing power and pattern recognition. Together, you generate insights that neither could achieve alone.   For organizations considering AI investments, success requires focusing on several key elements: - **Context development:** Invest time in articulating your specific environment, constraints, and objectives - **Collaborative processes:** Design approaches that keep humans involved throughout, not just at endpoints - **Domain expertise**: Ensure people who understand your work actively shape how AI is applied - **Human oversight:** Maintain wisdom to keep humans in the loop for critical decisions The question isn't whether the technology is sophisticated enough—it probably is. The question is whether you're prepared to invest in the *human* elements that make AI truly valuable. [mailto:?subject=Real%20Talk:%20AI%20Without%20Context%20Is%20Just%20Expensive%20Guesswork&body=https://blog.ccnyinc.org/blog/real-talk-ai-without-context-is-just-expensive-guesswork](mailto:?subject=Real%20Talk:%20AI%20Without%20Context%20Is%20Just%20Expensive%20Guesswork&body=https://blog.ccnyinc.org/blog/real-talk-ai-without-context-is-just-expensive-guesswork) - [mailto:?subject=Real%20Talk:%20AI%20Without%20Context%20Is%20Just%20Expensive%20Guesswork&body=https://blog.ccnyinc.org/blog/real-talk-ai-without-context-is-just-expensive-guesswork](mailto:?subject=Real%20Talk:%20AI%20Without%20Context%20Is%20Just%20Expensive%20Guesswork&body=https://blog.ccnyinc.org/blog/real-talk-ai-without-context-is-just-expensive-guesswork) ### Leave a reply Search #### Recent Posts - [Real Talk: AI Without Context Is Just Expensive Guesswork](https://blog.ccnyinc.org/blog/real-talk-ai-without-context-is-just-expensive-guesswork) - [Rethinking Nonprofits: A Conversation with David Monroe](https://blog.ccnyinc.org/blog/rethinking-nonprofits-a-conversation-with-david-monroe) #### Archives ### Posts by Tag - [October 2025 (1)](https://blog.ccnyinc.org/blog/archive/2025/10) - [September 2025 (1)](https://blog.ccnyinc.org/blog/archive/2025/09) #### Categories - [AI](https://blog.ccnyinc.org/blog/tag/ai) ![CCNY](https://blog.ccnyinc.org/hs-fs/hubfs/raw_assets/public/CCNY_Sep2021/images/ccny_logo_lrg-color.png?width=614&name=ccny_logo_lrg-color.png "CCNY") # Work with Us If you would like a private consultation on how CCNY can help your organization deliver value-based healthcare, please fill out the form and we'll be in touch soon to start a dialog. - CCNY, Inc. - [Our Story](https://ccnyinc.org/our-story/) - [Case Studies](https://ccnyinc.org/case-studies/) - [Data Collection Toolkit](https://ccnyinc.org/data-collection-toolkit/) - [Data Analysis Toolkit](https://ccnyinc.org/data-analysis-toolkit/) - [Performance Enhancement Toolkit](https://ccnyinc.org/performance-enhancement-toolkit/) - [Specialized Training](https://ccnyinc.org/specialized-training-2/) - [Program Evaluation Toolkit](https://ccnyinc.org/program-evaluation-toolkit/) - [Management Services](https://ccnyinc.org/management-services/) - [Project Portal](https://ccnyinc.org/project-portal/) - [IT Resources](https://ccnyinc.org/teamviewer-remote/) - [AROUNJA](http://arounja.com/) - [News](https://ccnyinc.org/news/) # CONTACT US 217 East Delavan Avenue Buffalo, New York 14208 PHONE: 716.855.0007 x303 FAX: 716.855.0004 # CONTACT US 217 E Delevan Ave Buffalo, New York 14208 PHONE: 716.855.0007 x303 FAX: 716.855.0004 [![address](https://blog.ccnyinc.org/hubfs/address.png)](https://www.google.com/maps/place/Greyhound:+Bus+Station/@42.8756159,-78.8564805,15z/data=!4m12!1m6!3m5!1s0x0:0x672118404552e690!2sCCNY+Inc.!8m2!3d42.8756159!4d-78.8564805!3m4!1s0x89d31247ff728791:0x74c170c020406705!8m2!3d42.8833936!4d-78.8720137) ![phone (1)](https://blog.ccnyinc.org/hubfs/phone%20(1).png) [![email2](https://blog.ccnyinc.org/hubfs/email2.png)](https://blog.ccnyinc.org/blog/info@ccnyinc.org) # CONNECT [![facebook](https://blog.ccnyinc.org/hubfs/facebook.svg)](https://www.facebook.com/CCNYInc/) [![linkedin](https://blog.ccnyinc.org/hubfs/linkedin.svg)](https://www.linkedin.com/company/community-connections-of-new-york-ccny/) [![twitter](https://blog.ccnyinc.org/hubfs/twitter.svg)](https://twitter.com/ComConnectNY) © 2020 CCNY, Inc. All rights reserved.