Establishing an AI-friendly infrastructure within the public sector
Federal Agencies Embrace AI Amid Resource Constraints
The landscape of cloud services is evolving, with the emergence of AI-specialized providers like CoreWeave, Lambda, and G42 making a significant impact. However, the challenge lies in consolidating multiple different vendors for AI and automation, as agencies strive to streamline their operations.
In the face of workforce reductions and tighter budgets, federal agencies are under pressure to do more with less. To fulfill their missions amid these constraints, they are focusing on interoperability, vendor consolidation, and streamlined FedRAMP certification processes.
- Interagency AI Coordination The White House’s 2025 AI Action Plan recommends formalizing the Chief Artificial Intelligence Officer Council (CAIOC) as the primary venue for interagency coordination and collaboration on AI adoption. This council works alongside other federal executive councils to ensure aligned AI technology and data standards across agencies, facilitating interoperability and efficient resource sharing.
- Centralized AI Procurement Toolbox Establishing an AI procurement toolbox, managed by the General Services Administration (GSA) in coordination with the Office of Management and Budget (OMB), enables agencies to select AI models and cloud services from a pre-vetted, standardized set of options. This reduces vendor fragmentation, lowers procurement complexity, and achieves economies of scale.
- Streamlined FedRAMP Certification Processes FedRAMP certification is essential for cloud services used in the federal government but can be a bottleneck for rapid AI adoption. Leveraging existing RAMP-certified offerings, such as those from major cloud providers like Accenture and Microsoft Azure Government, can reduce redundant certification efforts and accelerate deployment.
- Talent and Workforce Optimization The plan proposes initiatives like a talent-exchange program that allows rapid temporary assignment of specialized AI personnel across agencies. This supports mission-critical staffing needs without permanent employee growth, maximizing the utility of existing expertise.
- Modernizing Government Systems and Infrastructure Investment Investing in modern AI infrastructure and shared test environments enhances agencies’ capacity to deploy AI at scale efficiently, reducing duplication of effort and cost. Accelerated federal permitting for data center infrastructure further supports scalable AI implementations.
However, the growing power and cooling requirements for AI infrastructure pose a challenge for agencies. As they prepare to get AI-ready, they will need to shift more to infrastructure built by federal systems integrators and the cloud. Infrastructure investments should include storage and data warehousing, with the aim of contextualizing data for future AI use.
In the realm of cybersecurity, AI is having an immediate impact. Adversaries are using AI capabilities to attack critical infrastructure, and cyber analytics is a significant area of focus. Federal agencies are taking a cautious approach to AI adoption but are expected to implement it faster. For instance, the Defense Department is using AI for predictive maintenance purposes, and AI is being used to improve the customer experience for government agencies through chatbots and AI agents.
The General Services Administration's FedRAMP 20x program could bring approval times for cloud services down to three-to-six weeks, potentially allowing neo clouds to come into the federal government in a significant way. Agencies are also looking at automation tools to maximize the efficiency of their workforce. Many see their legacy IT systems as an obstacle to adopting AI, and chief information officers should make infrastructure investments today to become AI-ready, even if they don't have immediate use cases for AI.
In conclusion, federal agencies can drive AI readiness under resource constraints by institutionalizing interagency AI coordination, consolidating vendor offerings through a centralized procurement toolbox, leveraging and streamlining FedRAMP certifications with existing cloud platforms, enhancing workforce flexibility, and modernizing infrastructure per the latest White House AI Action Plan directives. These coordinated policies aim to reduce duplication, enhance interoperability, and accelerate AI adoption while maintaining security and compliance.
- Consolidated AI Infrastructure for Increased Efficiency To address the growing power and cooling demands of AI infrastructure, federal agencies are focusing their infrastructure investments on system integrators and the cloud. This strategy aims to improve resource efficiency by pooling their infrastructure needs within these platforms.
- Integrating AI into Federal Cybersecurity Given the increasing use of AI by adversaries to attack critical infrastructure, federal agencies are accelerating the implementation of AI in cybersecurity. By adopting AI-driven cyber analytics and tools, these agencies hope to enhance their defense capabilities against AI-powered threats.