Books, Courses & Certifications
‘School Choice’ Causes Confusion for Families. Can Edtech Companies Help?

Hayley Leibson, a mother from Mill Valley, a wealthy area just north of San Francisco, started hunting for a language-immersion child care program when her son was 8 months old.
“I thought I was really early,” Leibson says, noting that her son wasn’t going to attend until he turned 2. Some schools laughed her out of the room, telling her that other families applied as soon as they became pregnant.
Transitional kindergarten, a public early education program for 4-year-olds in California that provides a structured bridge between preschool and kindergarten, had been cut from her region for the 2025-2026 school year. Leibson says she felt the cut put extra pressure on her to find a private option.
But right away she noticed that the application process presented what she thought were ludicrous hurdles. Schools asked Leibson to write essays about her son’s “learning style” — before he could even talk — and demanded specific details about Leibson’s connection to families already attending those programs, such as listing out the last time she saw them and what they did together.
Mostly, Leibson spent a lot of time vetting programs. Meetings occurred when it was convenient for the care providers, meaning Leibson had to rearrange her own work schedule. Before inspecting a program, Leibson found it nearly impossible to discern whether the school seemed to her like a money-grab that didn’t care much about the kids. Options with rave reviews on Google would be run-down when she visited.
“It was like a part-time job — very time-consuming and hard,” she says.
It helped her to chat with teachers and other parents, who warned her of pest problems and other issues. “The most valuable are people who don’t go [to a school] anymore,” she adds.
After going through all that, programs would reject her son because he had difficulty napping or because of rules about potty training she considered wacky. When offers came in, providers would “explode” if Leibson didn’t accept within a short period of time, sometimes as brief as 24 hours.
So eventually, Leibson turned to a “navigator,” an edtech tool that helps parents sort through early education options. The tool lists parent reviews of schools and relevant information including how much the programs cost, streamlining the search process and providing more finely tuned information than Google. Leibson finally found child care. By that time, the whole process had dragged on for months.
Soon, that arduous experience might also become the norm for families trying to pick a primary or secondary school.
Driven by the rise of school vouchers, the company behind the navigator recently moved into K-12 education, in an attempt to build a “comprehensive” tool for parents struggling to figure out how to choose a school for their child. Indeed, there are a growing number of companies trying to help parents handle K-12 school options, according to Matthew Tower, vice president of strategy and research for Whiteboard Advisors, an education consultancy and advocacy firm.
Company leaders believe that what has helped mothers like Leibson navigate the confusion of finding child care and preschools in a country that lacks a robust public early education system could provide families a workable way to manage private school options for older kids, too, which suffer some of the same problems.
But other experts aren’t so sure, arguing that it might mask the issues with the emergent school choice system.

Struggling With Choice
When Donald Trump entered his second term as president, he boosted the “school choice” movement. Already making headway across the country, the system has reached new major milestones this year, such as when Texas signed a $1 billion voucher system into law at the beginning of May. And the GOP’s One Big Beautiful Bill Act, signed into law on July 4, includes a national school voucher plan, setting up scholarships for families to attend private schools around the country, which opponents term a “tax shelter” for wealthy private school supporters. States will have to opt in due to a last-minute change to the bill.
At the state level, these voucher systems divert money from public schools for parents to use on private school tuition, fees or related expenses. The systems are controversial, and a number of states have resisted them. Supporters claim they enhance parents’ choices, thereby improving educational quality. But opponents counter that they starve public schools of money and lower the quality of education in the country, also often pointing to the use of this system to evade school integration in Southern states after the 1954 Supreme Court decision in Brown v. Board of Education. These days, private schools retain greater leeway in turning away students, and they have weaker legal requirements for dealing with students with disabilities. Critics also point to some research that suggests vouchers are associated with a decline in student performance for low-income students.
The early childhood market is distinct from these K-12 options — for instance, early childhood is more fragmented, and chronically underfunded, according to David Blau, a labor and population economist and a professor emeritus at Ohio State University.
But there are some parallels between the child care subsidy system — which offsets the costs of programs that families in some states choose for their young children — and these new K-12 vouchers. For example, they have both proved thorny tangles for families, who have difficulty assessing quality of programs or making meaningful choices because there’s little accurate, accessible data about student academic outcomes at different institutions. They also lack adequate regulations, according to some researchers.
The similarities are at least strong enough that one edtech company says it can help parents across both markets.
Winnie, the child care marketplace navigator that Leibson used to find a preschool, expanded into K-12 schools this year. The company is trying to give parents a comprehensive search-and-filter tool for public, charter and private schools, says CEO Sara Mauskopf. The lines between early learning and K-12 schooling have blurred, with an uptick in the number of children attending independent schools from a younger age, Mauskopf says.
Now, the company has noticed a shift in what parents are searching for on its marketplace. These days, about 20 percent of parents on Winnie are exploring choices for children over the age of 5, according to Mauskopf. She attributes this largely to the rise of options. That includes school vouchers, which create a new incentive for families to shop around among charter and private schools rather than automatically enroll children in their assigned district public school. Mauskopf says that public charter schools also market heavily to families.
This new behavior is pushing Winnie further into the K-12 space. Mauskopf expects that the number of schools marketing directly to parents will only increase.
‘Smoke and Mirrors’
While marketplace navigators are relatively common in early childhood education, they are unusual in K-12, according to researchers. Mauskopf views her main competition as sites like Yelp or Google, to which some parents turn for information about prospective schools or child care options.
But some experts warn that this expanded approach is a cause for concern.
Cramming the disparate education systems together for parents in one tool can conceal meaningful differences, such as the fact that the child care world lacks a strong public system, unlike in K-12, as most students in the country already attend public elementary, middle and high schools, says Paige Shoemaker DeMio, a senior policy analyst for K-12 at the Center for American Progress (CAP).
The navigator doesn’t have transparent student performance data that would clarify which options are high quality, and yet parents will be likely to trust that school options listed on the app are good ones, according to CAP researchers. And the results families see when they use the tool are not totally objective, because schools can influence their profiles. Schools listed on the site can claim their page to update information and receive inquiries from parents. When a school changes its description, a disclaimer is added, according to Mauskopf.
The company also offers schools a service called Winnie Pro that boosts their listing in parents’ search results, and which allows schools to customize their listing on the site and track their performance more closely. For any given parent’s search, how many sponsored pages appear depends on the specifics of the search, and it rotates based on how many parent leads Winnie has already sent the school so far that month, Mauskopf says.
If the school voucher movement succeeds in directing more families away from public schools and toward charter or private schools, parents may indeed appreciate help making choices, perhaps through these kinds of tools. But giving parents a navigator doesn’t really solve the core issues that arise from having to choose among private and charter child care programs and schools, Shoemaker DeMio says, such as tuition prices that are too high to afford, admission policies that exclude students with disabilities or secretive practices that obscure data about how much students are learning.
By creating the illusion of transparency and accessibility, navigation tools may make it more difficult for families to actually exercise meaningful choices about education — making it all “smoke and mirrors,” Shoemaker DeMio argues.
What do families think — will they use the navigator for K-12 charter and private schools?
Some are.
Shannon Parola, a mother from El Dorado County, near Sacramento, struggled to adjust to a transitional kindergarten for her asthmatic daughter.
The family had moved from the Bay Area, where Parola had worked as a nanny. After the move, Parola used Winnie to find a private child care program that worked well.
But not long after, the family had a second child on the way. And with rising child care costs, they decided to “rip the Band-Aid off,” moving their daughter to the public transitional kindergarten program just down the street from where they lived, in the same elementary school zoned for their house.
When Parola got her daughter’s first report card back, it startled her. It was only October, and yet the report card indicated there was nowhere for her daughter to improve, Parola says. She was already meeting their standards, Parola recalls. Still, the school wouldn’t bump her daughter to kindergarten, citing a lack of room. Parola, who volunteered in her daughter’s classroom, noticed her complaining of boredom. She worried that the cycle would repeat itself the next year. So, the family moved her to a charter homeschool program.
They pay “out the butt” for the program, she says. But she’s happy with how it worked out, she adds: “We wanted the best for our daughter.”
She’s less happy with how long the process took.
To find the program, Parola tried Greatschools.com, a nonprofit rating system for schools, also used by realty companies like Zillow for third-party evaluations of public schools. But Parola says the ratings weren’t terribly reliable or hadn’t been updated in a long time, meaning she had to cross-reference information with local moms on Facebook.
That was before Winnie’s K-12 search, and the process dragged on for an entire year, Parola says. Without a one-stop shop for evaluating all the possibilities available to her — public, charter, private and homeschool options — Parola felt as if she was being denied the information that would have allowed her to make a truly informed choice.
Now Parola, who runs a child care coaching business, recommends the navigator service to other parents. She’s also used it for more recent searches, including for finding summer care and camps. That’s because it lists all the options — including ones that are tough to find through Google reviews — while also capturing information about licensing and safety measures, Parola says.
Mauskopf says that demand is driving the company’s expansion, showing that families are using the marketplace tool to wade through the sea of private and charter K-12 options in front of them.
Certainly, when talking to other parents, Parola can feel the strain making these choices puts on them.
“I think parents are just so overwhelmed, not only with choices [but] with life and everything,” she says. “If you talk about, ‘Oh, now I’ve got to learn a whole process of how to find my kid’s school, how to find child care,’ it sends them down into a deep spiral.”
Books, Courses & Certifications
Student Scores in Math, Science, Reading Slide Again on Nation’s Report Card

Exasperating. Depressing. Predictable.
That’s how experts describe the latest results from the National Assessment of Educational Progress, also known as the “nation’s report card.”
Considered a highly accurate window into student performance, the assessment has become a periodic reminder of declining academic success among students in the U.S., with the last several rounds accentuating yearslong slumps in learning. In January, for instance, the previous round of NAEP results revealed the biggest share of eighth graders who did not meet basic reading proficiency in the assessment’s history.
Now, the latest results, released Tuesday after a delay, showed continued decline.
Eighth graders saw the first fall in average science scores since the assessment took its current form in 2009. The assessment looked at physical science, life science, and earth and space sciences. Thirty-eight percent of students performed below basic, a level which means these students probably don’t know that plants need sunlight to grow and reproduce, according to NAEP. In contrast, only 31 percent of students performed at proficient levels.
Twelfth graders saw a three-point fall in average math and reading scores, compared to results from 2019. The exam also shows that the achievement gap between high- and low-scoring students is swelling, a major point of concern. In math, the gap is wider than it’s ever been.
But most eye-grabbing is the fact that 45 percent of high school seniors — the highest percentage ever recorded — scored below basic in math, meaning they cannot determine probabilities of simple events from two-way tables and verbal descriptions. In contrast, just 22 percent scored at-or-above proficient. In reading, 32 percent scored below basic, and 35 percent met the proficient threshold. Twelfth grade students also reported high rates of absenteeism.
Tucked inside the report was the finding that parents’ education did not appear to hold much sway on student performance in the lower quartiles, which will bear further unpacking, according to one expert’s first analysis.
But the scores contained other glum trends, as well.
For example, the gap in outcomes in the sciences between male and female students, which had narrowed in recent years, bounced back. (A similar gap in math reappeared since the pandemic, pushing educators to get creative in trying to nourish girls’ interest in the subject.)
But with teacher shortages and schools facing enrollment declines and budget shortfalls, experts say it’s not surprising that students still struggle. Those who watch education closely describe themselves as tired, exasperated and even depressed from watching a decade’s worth of student performance declines. They also express doubt that political posturing around the scores will translate into improvements.
Political Posturing
Despite a sterling reputation, the assessment found itself snagged by federal upheaval.
NAEP is a congressionally mandated program run by the National Center for Education Statistics. Since the last round of results was released, back in January, the center and the broader U.S. Department of Education have dealt with shredded contracts, mass firings and the sudden dismissal of Peggy Carr, who’d helped burnish the assessment’s reputation and statistical rigor and whose firing delayed the release of these latest results.
The country’s education system overall has also undergone significant changes, including the introduction of a national school choice plan, meant to shift public dollars to private schools, through the Republican budget.
Declining scores provide the Trump administration a potential cudgel for its dismantling of public education, and some have seized upon it: Congressman Tim Walberg, a Republican from Michigan and chairman of the House Education and Workforce Committee, blamed the latest scores on the Democrats’ “student-last policies,” in a prepared statement.
“The lesson is clear,” argued Education Secretary Linda McMahon in her comment on the latest scores. “Success isn’t about how much money we spend, but who controls the money and where that money is invested,” she wrote, stressing that students need an approach that returns control education to the states.
Some observers chortle at the “back to the states” analysis. After all, state and local governments already control most of the policies and spending related to public schools.
Regardless, experts suggest that just pushing more of education governance to the states will not solve the underlying causes of declining student performance. Declines in scores predate the pandemic, they also say.
No Real Progress
States have always been in charge of setting their own standards and assessments, says Latrenda Knighten, president of the National Council of Teachers of Mathematics. These national assessments are useful for comparing student performance across states, she adds.
Ultimately, in her view, the latest scores reveal the need for efforts to boost high-quality instruction and continuous professional learning for teachers to address systemic issues, a sentiment reflected in her organization’s public comment on the assessment. The results shine a spotlight on the need for greater opportunity in high school mathematics across the country, Knighten told EdSurge. She believes that means devoting more money for teacher training.
Some think that the causes of this academic slide are relatively well understood.
Teacher quality has declined, as teacher prep programs struggle to supply qualified teachers, particularly in math, and schools struggle to fill vacancies, says Robin Lake, director of the Center on Reinventing Public Education. She argues there has also been a decline in the desire to push schools to be accountable for poor student performance, and an inability to adapt.
There’s also confusion about which curriculum is best for students, she says. For instance, fierce debates continue to split teachers around “tracking,” where students are grouped into math paths based on perceived ability.
But will yet another poor national assessment spur change?
The results continue a decade-long decline in student performance, says Christy Hovanetz, a senior policy fellow for the nonprofit ExcelinEd.
Hovanetz worries that NAEP’s potential lessons will get “lost in the wash.” What’s needed is a balance between turning more authority back over to the states to operate education and a more robust requirement for accountability that allows states to do whatever they want, so long as they demonstrate it’s actually working, she says. That could mean requiring state assessments and accountability systems, she adds.
But right now, a lot of the states aren’t focusing on best practices for science and reading instruction, and they aren’t all requiring high-quality instructional materials, she says.
Worse, some are lowering the standards to meet poor student performance, she argues. For instance, Kansas recently altered its state testing. The changes, which involved changing score ranges, have drawn concerns from parents that the state is watering down standards. Hovanetz thinks that’s the case. In making the changes, the state joined Illinois, Wisconsin and Oklahoma in lowering expectations for students on state tests, she argues.
What’s uncontested from all perspectives is that the education system isn’t working.
“It’s truly the definition of insanity: to keep doing what we’re doing and hoping for better results,” says Lake, of the Center on Reinventing Public Education, adding: “We’re not getting them.”
Books, Courses & Certifications
How School-Family Partnerships Can Boost Early Literacy

When the National Assessment of Educational Progress, often called the Nation’s Report Card, was released last year, the results were sobering. Despite increased funding streams and growing momentum behind the Science of Reading, average fourth grade reading scores declined by another two points from 2022.
In a climate of growing accountability and public scrutiny, how can we do things differently — and more effectively — to ensure every child becomes a proficient reader?
The answer lies not only in what happens inside the classroom but in the connections forged between schools and families. Research shows that when families are equipped with the right tools and guidance, literacy development accelerates. For many schools, creating this home-to-school connection begins by rethinking how they communicate with and involve families from the start.
A School-Family Partnership in Practice
My own experience with my son William underscored just how impactful a strong school-family partnership can be.
When William turned four, he began asking, “When will I be able to read?” He had watched his older brother learn to read with relative ease, and, like many second children, William was eager to follow in his big brother’s footsteps. His pre-K teacher did an incredible job introducing foundational literacy skills, but for William, it wasn’t enough. He was ready to read, but we, his parents, weren’t sure how to support him.
During a parent-teacher conference, his teacher recommended a free, ad-free literacy app that she uses in her classroom. She assigned stories to read and phonics games to play that aligned with his progress at school. The characters in the app became his friends, and the activities became his favorite challenge. Before long, he was recognizing letters on street signs, rhyming in the car and asking to read his favorite stories over and over again.
William’s teacher used insights from his at-home learning to personalize his instruction in the classroom. For our family, this partnership made a real difference.
Where Literacy Begins: Bridging Home and School
Reading develops in stages, and the pre-K to kindergarten years are especially foundational. According to the National Reading Panel and the Institute of Education Sciences, five key pillars support literacy development:
- Phonemic awareness: recognizing and playing with individual sounds in spoken words
- Phonics: connecting those sounds to written letters
- Fluency: reading with ease, accuracy and expression
- Vocabulary: understanding the meaning of spoken and written words
- Comprehension: making sense of what is read
For schools, inviting families into this framework doesn’t mean making parents into teachers. It means providing simple ways for families to reinforce these pillars at home, often through everyday routines, such as reading together, playing language games or talking about daily activities.
Families are often eager to support their children’s reading, but many aren’t sure how. At the same time, educators often struggle to communicate academic goals to families in ways that are clear and approachable.
Three Ways to Strengthen School-Family Literacy Partnerships
Forging effective partnerships between schools and families can feel daunting, but small, intentional shifts can make a powerful impact. Here are three research-backed strategies that schools can use to bring families into the literacy-building process.
1. Communicate the “why” and the “how”
Families become vital partners when they understand not just what their children are learning, but why it matters. Use newsletters, family literacy nights or informal conversations to break down the five pillars in accessible terms. For example, explain that clapping out syllables at home supports phonemic awareness or that spotting road signs helps with letter recognition (phonics).
Even basic activities can reinforce classwork. Sample ideas for family newsletters:
- “This week we’re working on beginning sounds. Try playing a game where you name things in your house that start with the letter ‘B’.”
- “We’re focusing on listening to syllables in words. See if your child can clap out the beats in their name!”
Provide families with specific activities that match what is being taught at school. For example, William’s teacher used the Khan Academy Kids app to assign letter-matching games and read-aloud books that aligned with classroom learning. The connection made it easier for us to support him at home.
2. Establish everyday reading routines
Consistency builds confidence. Encourage families to create regular reading moments, such as a story before bed, a picture book over breakfast or a read-aloud during bath time. Reinforce that reading together in any language is beneficial. Oral storytelling, silly rhymes and even talking through the day’s events help develop vocabulary and comprehension.
Help parents understand that it’s okay to stop when it’s no longer fun. If a child isn’t interested, it’s better to pause and return later than to force the activity. The goal is for children to associate reading with enjoyment and a sense of connection.
3. Empower families with fun, flexible tools
Families are more likely to participate when activities are playful and accessible, not just another assignment. Suggest resources that fit different family preferences: printable activity sheets, suggested library books and no-cost, ad-free digital platforms, such as Khan Academy Kids. These give children structured ways to practice and offer families tools that are easy to use, even with limited time.
In our district, many families use technology to extend classroom skills at home. For William, a rhyming game on a literacy app made practicing phonological awareness fun and stress-free; he returned to it repeatedly, reinforcing new skills through play.
Literacy Grows Best in Partnership
School-family partnerships also offer educators valuable feedback. When families share observations about what excites or challenges their children at home, teachers gain a fuller picture of each student’s progress. Digital platforms, such as teacher, school and district-level reporting, can support this feedback loop by providing teachers with real-time data on at-home practice. This two-way exchange strengthens instruction and empowers both families and educators.
While curriculum, assessment and skilled teaching are essential, literacy is most likely to flourish when nurtured by both schools and families. When educators invite families into the process — demystifying the core elements of literacy, sharing routines and providing flexible, accessible tools — they help create a culture where reading is valued everywhere.
Strong school-family partnerships don’t just address achievement gaps. They lay the groundwork for the joy, confidence and curiosity that help children become lifelong readers.
At Khan Academy Kids, we believe in the power of the school-family partnership. For free resources to help strengthen children’s literacy development, explore the Khan Academy Kids resource hub for schools.
Books, Courses & Certifications
TII Falcon-H1 models now available on Amazon Bedrock Marketplace and Amazon SageMaker JumpStart

This post was co-authored with Jingwei Zuo from TII.
We are excited to announce the availability of the Technology Innovation Institute (TII)’s Falcon-H1 models on Amazon Bedrock Marketplace and Amazon SageMaker JumpStart. With this launch, developers and data scientists can now use six instruction-tuned Falcon-H1 models (0.5B, 1.5B, 1.5B-Deep, 3B, 7B, and 34B) on AWS, and have access to a comprehensive suite of hybrid architecture models that combine traditional attention mechanisms with State Space Models (SSMs) to deliver exceptional performance with unprecedented efficiency.
In this post, we present an overview of Falcon-H1 capabilities and show how to get started with TII’s Falcon-H1 models on both Amazon Bedrock Marketplace and SageMaker JumpStart.
Overview of TII and AWS collaboration
TII is a leading research institute based in Abu Dhabi. As part of UAE’s Advanced Technology Research Council (ATRC), TII focuses on advanced technology research and development across AI, quantum computing, autonomous robotics, cryptography, and more. TII employs international teams of scientists, researchers, and engineers in an open and agile environment, aiming to drive technological innovation and position Abu Dhabi and the UAE as a global research and development hub in alignment with the UAE National Strategy for Artificial Intelligence 2031.
TII and Amazon Web Services (AWS) are collaborating to expand access to made-in-the-UAE AI models across the globe. By combining TII’s technical expertise in building large language models (LLMs) with AWS Cloud-based AI and machine learning (ML) services, professionals worldwide can now build and scale generative AI applications using the Falcon-H1 series of models.
About Falcon-H1 models
The Falcon-H1 architecture implements a parallel hybrid design, using elements from Mamba and Transformer architectures to combine the faster inference and lower memory footprint of SSMs like Mamba with the effectiveness of Transformers’ attention mechanism in understanding context and enhanced generalization capabilities. The Falcon-H1 architecture scales across multiple configurations ranging from 0.5–34 billion parameters and provides native support for 18 languages. According to TII, the Falcon-H1 family demonstrates notable efficiency with published metrics indicating that smaller model variants achieve performance parity with larger models. Some of the benefits of Falcon-H1 series include:
- Performance – The hybrid attention-SSM model has optimized parameters with adjustable ratios between attention and SSM heads, leading to faster inference, lower memory usage, and strong generalization capabilities. According to TII benchmarks published in Falcon-H1’s technical blog post and technical report, Falcon-H1 models demonstrate superior performance across multiple scales against other leading Transformer models of similar or larger scales. For example, Falcon-H1-0.5B delivers performance similar to typical 7B models from 2024, and Falcon-H1-1.5B-Deep rivals many of the current leading 7B-10B models.
- Wide range of model sizes – The Falcon-H1 series includes six sizes: 0.5B, 1.5B, 1.5B-Deep, 3B, 7B, and 34B, with both base and instruction-tuned variants. The Instruct models are now available in Amazon Bedrock Marketplace and SageMaker JumpStart.
- Multilingual by design – The models support 18 languages natively (Arabic, Czech, German, English, Spanish, French, Hindi, Italian, Japanese, Korean, Dutch, Polish, Portuguese, Romanian, Russian, Swedish, Urdu, and Chinese) and can scale to over 100 languages according to TII, thanks to a multilingual tokenizer trained on diverse language datasets.
- Up to 256,000 context length – The Falcon-H1 series enables applications in long-document processing, multi-turn dialogue, and long-range reasoning, showing a distinct advantage over competitors in practical long-context applications like Retrieval Augmented Generation (RAG).
- Robust data and training strategy – Training of Falcon-H1 models employs an innovative approach that introduces complex data early on, contrary to traditional curriculum learning. It also implements strategic data reuse based on careful memorization window assessment. Additionally, the training process scales smoothly across model sizes through a customized Maximal Update Parametrization (µP) recipe, specifically adapted for this novel architecture.
- Balanced performance in science and knowledge-intensive domains – Through a carefully designed data mixture and regular evaluations during training, the model achieves strong general capabilities and broad world knowledge while minimizing unintended specialization or domain-specific biases.
In line with their mission to foster AI accessibility and collaboration, TII have released Falcon-H1 models under the Falcon LLM license. It offers the following benefits:
- Open source nature and accessibility
- Multi-language capabilities
- Cost-effectiveness compared to proprietary models
- Energy-efficiency
About Amazon Bedrock Marketplace and SageMaker JumpStart
Amazon Bedrock Marketplace offers access to over 100 popular, emerging, specialized, and domain-specific models, so you can find the best proprietary and publicly available models for your use case based on factors such as accuracy, flexibility, and cost. On Amazon Bedrock Marketplace you can discover models in a single place and access them through unified and secure Amazon Bedrock APIs. You can also select your desired number of instances and the instance type to meet the demands of your workload and optimize your costs.
SageMaker JumpStart helps you quickly get started with machine learning. It provides access to state-of-the-art model architectures, such as language models, computer vision models, and more, without having to build them from scratch. With SageMaker JumpStart you can deploy models in a secure environment by provisioning them on SageMaker inference instances and isolating them within your virtual private cloud (VPC). You can also use Amazon SageMaker AI to further customize and fine-tune the models and streamline the entire model deployment process.
Solution overview
This post demonstrates how to deploy a Falcon-H1 model using both Amazon Bedrock Marketplace and SageMaker JumpStart. Although we use Falcon-H1-0.5B as an example, you can apply these steps to other models in the Falcon-H1 series. For help determining which deployment option—Amazon Bedrock Marketplace or SageMaker JumpStart—best suits your specific requirements, see Amazon Bedrock or Amazon SageMaker AI?
Deploy Falcon-H1-0.5B-Instruct with Amazon Bedrock Marketplace
In this section, we show how to deploy the Falcon-H1-0.5B-Instruct model in Amazon Bedrock Marketplace.
Prerequisites
To try the Falcon-H1-0.5B-Instruct model in Amazon Bedrock Marketplace, you must have access to an AWS account that will contain your AWS resources.Prior to deploying Falcon-H1-0.5B-Instruct, verify that your AWS account has sufficient quota allocation for ml.g6.xlarge instances. The default quota for endpoints using several instance types and sizes is 0, so attempting to deploy the model without a higher quota will trigger a deployment failure.
To request a quota increase, open the AWS Service Quotas console and search for Amazon SageMaker. Locate ml.g6.xlarge for endpoint usage and choose Request quota increase, then specify your required limit value. After the request is approved, you can proceed with the deployment.
Deploy the model using the Amazon Bedrock Marketplace UI
To deploy the model using Amazon Bedrock Marketplace, complete the following steps:
- On the Amazon Bedrock console, under Discover in the navigation pane, choose Model catalog.
- Filter for Falcon-H1 as the model name and choose Falcon-H1-0.5B-Instruct.
The model overview page includes information about the model’s license terms, features, setup instructions, and links to further resources.
- Review the model license terms, and if you agree with the terms, choose Deploy.
- For Endpoint name, enter an endpoint name or leave it as the default pre-populated name.
- To minimize costs while experimenting, set the Number of instances to 1.
- For Instance type, choose from the list of compatible instance types. Falcon-H1-0.5B-Instruct is an efficient model, so ml.m6.xlarge is sufficient for this exercise.
Although the default configurations are typically sufficient for basic needs, you can customize advanced settings like VPC, service access permissions, encryption keys, and resource tags. These advanced settings might require adjustment for production environments to maintain compliance with your organization’s security protocols.
- Choose Deploy.
- A prompt asks you to stay on the page while the AWS Identity and Access Management (IAM) role is being created. If your AWS account lacks sufficient quota for the selected instance type, you’ll receive an error message. In this case, refer to the preceding prerequisite section to increase your quota, then try the deployment again.
While deployment is in progress, you can choose Marketplace model deployments in the navigation pane to monitor the deployment progress in the Managed deployment section. When the deployment is complete, the endpoint status will change from Creating to In Service.
Interact with the model in the Amazon Bedrock Marketplace playground
You can now test Falcon-H1 capabilities directly in the Amazon Bedrock playground by selecting the managed deployment and choosing Open in playground.
You can now use the Amazon Bedrock Marketplace playground to interact with Falcon-H1-0.5B-Instruct.
Invoke the model using code
In this section, we demonstrate to invoke the model using the Amazon Bedrock Converse API.
Replace the placeholder code with the endpoint’s Amazon Resource Name (ARN), which begins with arn:aws:sagemaker
. You can find this ARN on the endpoint details page in the Managed deployments section.
To learn more about the detailed steps and example code for invoking the model using Amazon Bedrock APIs, refer to Submit prompts and generate response using the API.
Deploy Falcon-H1-0.5B-Instruct with SageMaker JumpStart
You can access FMs in SageMaker JumpStart through Amazon SageMaker Studio, the SageMaker SDK, and the AWS Management Console. In this walkthrough, we demonstrate how to deploy Falcon-H1-0.5B-Instruct using the SageMaker Python SDK. Refer to Deploy a model in Studio to learn how to deploy the model through SageMaker Studio.
Prerequisites
To deploy Falcon-H1-0.5B-Instruct with SageMaker JumpStart, you must have the following prerequisites:
- An AWS account that will contain your AWS resources.
- An IAM role to access SageMaker AI. To learn more about how IAM works with SageMaker AI, see Identity and Access Management for Amazon SageMaker AI.
- Access to SageMaker Studio with a JupyterLab space, or an interactive development environment (IDE) such as Visual Studio Code or PyCharm.
Deploy the model programmatically using the SageMaker Python SDK
Before deploying Falcon-H1-0.5B-Instruct using the SageMaker Python SDK, make sure you have installed the SDK and configured your AWS credentials and permissions.
The following code example demonstrates how to deploy the model:
When the previous code segment completes successfully, the Falcon-H1-0.5B-Instruct model deployment is complete and available on a SageMaker endpoint. Note the endpoint name shown in the output—you will replace the placeholder in the following code segment with this value.The following code demonstrates how to prepare the input data, make the inference API call, and process the model’s response:
Clean up
To avoid ongoing charges for AWS resources used while experimenting with Falcon-H1 models, make sure to delete all deployed endpoints and their associated resources when you’re finished. To do so, complete the following steps:
- Delete Amazon Bedrock Marketplace resources:
- On the Amazon Bedrock console, choose Marketplace model deployment in the navigation pane.
- Under Managed deployments, choose the Falcon-H1 model endpoint you deployed earlier.
- Choose Delete and confirm the deletion if you no longer need to use this endpoint in Amazon Bedrock Marketplace.
- Delete SageMaker endpoints:
- On the SageMaker AI console, in the navigation pane, choose Endpoints under Inference.
- Select the endpoint associated with the Falcon-H1 models.
- Choose Delete and confirm the deletion. This stops the endpoint and avoids further compute charges.
- Delete SageMaker models:
- On the SageMaker AI console, choose Models under Inference.
- Select the model associated with your endpoint and choose Delete.
Always verify that all endpoints are deleted after experimentation to optimize costs. Refer to the Amazon SageMaker documentation for additional guidance on managing resources.
Conclusion
The availability of Falcon-H1 models in Amazon Bedrock Marketplace and SageMaker JumpStart helps developers, researchers, and businesses build cutting-edge generative AI applications with ease. Falcon-H1 models offer multilingual support (18 languages) across various model sizes (from 0.5B to 34B parameters) and support up to 256K context length, thanks to their efficient hybrid attention-SSM architecture.
By using the seamless discovery and deployment capabilities of Amazon Bedrock Marketplace and SageMaker JumpStart, you can accelerate your AI innovation while benefiting from the secure, scalable, and cost-effective AWS Cloud infrastructure.
We encourage you to explore the Falcon-H1 models in Amazon Bedrock Marketplace or SageMaker JumpStart. You can use these models in AWS Regions where Amazon Bedrock or SageMaker JumpStart and the required instance types are available.
For further learning, explore the AWS Machine Learning Blog, SageMaker JumpStart GitHub repository, and Amazon Bedrock User Guide. Start building your next generative AI application with Falcon-H1 models and unlock new possibilities with AWS!
Special thanks to everyone who contributed to the launch: Evan Kravitz, Varun Morishetty, and Yotam Moss.
About the authors
Mehran Nikoo leads the Go-to-Market strategy for Amazon Bedrock and agentic AI in EMEA at AWS, where he has been driving the development of AI systems and cloud-native solutions over the last four years. Prior to joining AWS, Mehran held leadership and technical positions at Trainline, McLaren, and Microsoft. He holds an MBA from Warwick Business School and an MRes in Computer Science from Birkbeck, University of London.
Mustapha Tawbi is a Senior Partner Solutions Architect at AWS, specializing in generative AI and ML, with 25 years of enterprise technology experience across AWS, IBM, Sopra Group, and Capgemini. He has a PhD in Computer Science from Sorbonne and a Master’s degree in Data Science from Heriot-Watt University Dubai. Mustapha leads generative AI technical collaborations with AWS partners throughout the MENAT region.
Jingwei Zuo is a Lead Researcher at the Technology Innovation Institute (TII) in the UAE, where he leads the Falcon Foundational Models team. He received his PhD in 2022 from University of Paris-Saclay, where he was awarded the Plateau de Saclay Doctoral Prize. He holds an MSc (2018) from the University of Paris-Saclay, an Engineer degree (2017) from Sorbonne Université, and a BSc from Huazhong University of Science & Technology.
John Liu is a Principal Product Manager for Amazon Bedrock at AWS. Previously, he served as the Head of Product for AWS Web3/Blockchain. Prior to joining AWS, John held various product leadership roles at public blockchain protocols and financial technology (fintech) companies for 14 years. He also has nine years of portfolio management experience at several hedge funds.
Hamza MIMI is a Solutions Architect for partners and strategic deals in the MENAT region at AWS, where he bridges cutting-edge technology with impactful business outcomes. With expertise in AI and a passion for sustainability, he helps organizations architect innovative solutions that drive both digital transformation and environmental responsibility, transforming complex challenges into opportunities for growth and positive change.
-
Business2 weeks ago
The Guardian view on Trump and the Fed: independence is no substitute for accountability | Editorial
-
Tools & Platforms1 month ago
Building Trust in Military AI Starts with Opening the Black Box – War on the Rocks
-
Ethics & Policy2 months ago
SDAIA Supports Saudi Arabia’s Leadership in Shaping Global AI Ethics, Policy, and Research – وكالة الأنباء السعودية
-
Events & Conferences4 months ago
Journey to 1000 models: Scaling Instagram’s recommendation system
-
Jobs & Careers2 months ago
Mumbai-based Perplexity Alternative Has 60k+ Users Without Funding
-
Podcasts & Talks2 months ago
Happy 4th of July! 🎆 Made with Veo 3 in Gemini
-
Education2 months ago
Macron says UK and France have duty to tackle illegal migration ‘with humanity, solidarity and firmness’ – UK politics live | Politics
-
Education2 months ago
VEX Robotics launches AI-powered classroom robotics system
-
Funding & Business2 months ago
Kayak and Expedia race to build AI travel agents that turn social posts into itineraries
-
Podcasts & Talks2 months ago
OpenAI 🤝 @teamganassi