Connect with us

AI Insights

Down and out with Cerebras Code

Published

on


Out of Fireworks and into the fire

However, my start with Cerebras’s hosted Qwen was not the same as what I experienced (for a lot more money) on Fireworks, another provider. Initially, Cerebras’s Qwen didn’t even work in my CLI. It also didn’t seem to work in Roo Code or any other tool I knew how to use. After taking a bug report, Cerebras told me it was my code. My same CLI that worked on Fireworks, for Claude, for GPT-4.1 and GPT-5, for o3, for Qwen hosted by Qwen/Alibaba was at fault, said Cerebras. To be fair, my log did include deceptive artifacts when Cerebras fragmented the stream, putting out stream parts as messages (which Cerebras still does on occasion). However, this has been generally their approach. Don’t fix their so-called OpenAI compatibility—blame and/or adapt the client. I took the challenge and adapted my CLI, but it was a lot of workarounds. This was a massive contrast with Fireworks. I had issues with Fireworks when it started and showed them my debug output; they immediately acknowledged the problem (occasionally it would spit out corrupt, native tool calls instead of OpenAI-style output) and fixed it overnight. Cerebras repeatedly claimed their infrastructure was working perfectly and requests were all successful—in direct contradiction to most commentary on their Discord.

Feeling like I had finally cracked the nut after three weeks of on-and-off testing and adapting, I grabbed a second Cerebras Code Max account when the window opened again. This was after discovering that for part of the time, Cerebras had charged me for a Max account but given me a Pro account. They fixed it and offered no compensation for the days my service was set to Pro, not Max, and it is difficult to prove because their analytics console is broken, in part because it provides measurements in local time, but the limits are in UTC.

Then I did the math. One Cerebras Code Max account is limited to 120 million tokens per day at a cost equivalent to four times that of a Cerebras Code Pro account. The Pro account is 24 million tokens per day. If you multiply that by four, you get 96 million tokens. However, the Pro account is limited to 300k tokens per minute, compared to 400k for the Max. Using Cerebras is a bit frustrating. For 10 to 20 seconds, it really flies, then you hit the cap on tokens per minute, and it throws 429 errors (too many requests) until the minute is up. If your coding tool is smart, it will just retry with an exponential back-off. If not, it will break the stream. So, had I bought four Pro accounts, I could have had 1,200,000 TPM in theory, a much better value than the Max account.



Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

AI Insights

New AI Technique Unravels Quantum Atomic Vibrations in Materials

Published

on





New AI Technique Unravels Quantum Atomic Vibrations in Materials<br /> – </p> <p> www.caltech.edu













skip to main content





Source link

Continue Reading

AI Insights

Artificial Intelligence finds its way into police departments

Published

on


From drones to body cameras, artificial intelligence is changing how police departments are investigating crimes and train officers.

While law enforcement leaders call it efficient and lifesaving, questions remain about bias, transparency and how far the technology will go.

That shift is already underway in Southwest Florida, where police departments are beginning to rely on artificial intelligence in daily operations.

In Cape Coral, police are using artificial intelligence to analyze bank records, transcribe body-camera footage and train officers through virtual reality. As the tools continue to grow, so do debates over how far AI should go in law enforcement. Supporters say the technology saves time along with improving overall safety, but experts warn that without strict oversight, it could raise concerns about misuse.

“On the street, AI is frequently employed in conjunction with our axon body-worn cameras,” Officer Mercedes Simonds said. “The system automatically transcribes all recorded calls for us and can redact sensitive information, like blurring faces and license plates, this helps everyone and make sure we protect privacy and stay in compliance.”

Simonds is the Public Affairs Officer for Cape Coral police and is assigned to the Office of the Chief of Police. She joined the agency in July 2022 after serving three years with the Montgomery County Police Department in Maryland.

As Simonds highlights the efficiency of body cameras, Dr. David Thomas, a professor at Florida Gulf Coast University and former police officer, said the cameras have reshaped policing.

“I think the video is probably the best thing; body cams are the best thing that ever happened not only for the cops involved but mainly for the public,” Thomas said. “The ACLU argued that we would be peering into people’s lives and destroying their privacy. But it gives us that window to be able to look and see.”

Simonds also talks about how drones, which the department considers part of its AI toolkit, play a growing role in patrol and special operations. They are deployed to search for missing people, capture aerial views of crash scenes and track suspects during active calls.

“In several cases, children who wandered away from home were found quickly because of our drones,” Simonds said. “That technology has helped us bring families back together and avoid what could have been dangerous outcomes.”

AI is also being incorporated into officer training. Cape Coral police use virtual reality headsets to run through active shooter simulations, allowing officers to practice decision-making in high-stress environments.

“Our department currently uses a software program that leverages artificial intelligence to process and analyze large volumes of documents and subpoenas,” Simonds said. “This tool is particularly valuable when we receive bank statements as part of investigations because it can quickly extract the most pertinent information, saving officers a significant amount of time and effort.”

For the past several years, Thomas has trained officers across the country on use of force, policing tactics and professionalism, using both his street experience and academic research. He also believes that AI can be a useful tool for training, giving officers new ways to practice and prepare for real life situations.

“One agency invited me up to see their taser training. They’ve got a whole AI system, and it’s amazing. You’re standing there with your taser, walking through the scenario, and you’re interacting the whole time,” Thomas said. “The technology is great because it gives immediate feedback and trainers along with officers, can learn in the moment what to do differently.”

Along with AI being integrated with hands-on training and operations, it is also being tied to collecting and organizing data.

Simonds said how critical AI also is behind the scenes. She talks about how it is used during investigations by analyzing data and providing insights that would otherwise take much longer.

“AI has significantly improved efficiency within our department by saving officers valuable time,” Simonds said. “Tasks that were once manual completed can now be automated or assisted by AI programs, which lets officers focus more on critical duties. That shift has a positive impact on safety, resource management and timely responses to incidents.”

John Whitaker, a 62-year-old retired firefighter from North Fort Myers, said his concerns lie with the risks of putting too much trust in technology.

“I understand that there is a need for progress, but when I hear about AI making decisions in police work, it worries me,” Whitaker said. “What happens if the system makes a mistake or gets abused by the wrong people? Such a small error could have big consequences.”

He added that the stakes feel higher when technologies that can be unreliable are tied to public safety.

“I just hope we don’t lose sight of the importance of human judgment and compassion,” Whitaker said. “We can’t get lazy; we have to make sure that the safety of the citizens come first.”

Other residents such as Monica Montesino, a 36-year-old Cape Coral resident, said she supports police using AI tools like drones and virtual reality training.

“When I hear about drones helping to find missing kids or AI is helping train and prepare officers for dangerous situations, it makes me feel safer,” Montesino said. “I believe with these tools in place officers are better equipped for their jobs, and that helps protect all of us in the community.”

She added that although overuse of technology has downsides, if used properly it has a plethora of benefits.

“Of course, there are always risks with new technology, and I know mistakes can happen,” Montesino said. “But compared to the benefits, my concerns are very small. I’d rather see police have these tools that can help everyone instead of holding back out of fear.”

While residents such as Montesino welcome the changes, Cape Coral police officials say they are also aware of the concerns that come with adopting new technology.

“So far, our department has not encountered significant issues with adopting AI,” Simonds said. “But we remain cautious and make sure any AI-generated responses are carefully verified by officers before we act on them. That helps us maintain accuracy and avoid errors or biases influencing critical decisions.”

Experts such as Dr. Thomas share similar concerns. He said that while technology can be helpful, there is always a risk that police officers could misuse AI.

“You’ll never see me where I think technology is a bad thing. Unless they find an abuse for it and when you’re talking about cops, they will find an abuse for it,” Thomas said.

Whether you agree with AI or not, it is here and already active in local law enforcement. Cape Coral police officials say that AI will only continue to grow in the years ahead, and they are preparing for a future where AI becomes a larger part of daily operations.

“We are currently exploring additional software solutions that can automatically transcribe audio and video from incidents and generate detailed reports or synopses, additionally, we are also investigating real-time language translation software to improve communication with non-English-speaking community members” Simonds said. “This will save an invaluable amount of time for officers, and new improvements like these can help everyone involved.”

WGCU is your trusted source for news and information in Southwest Florida. We are a nonprofit public service, and your support is more critical than ever. Keep public media strong and donate now. Thank you.





Source link

Continue Reading

AI Insights

Duke University pilot project examining pros and cons of using artificial intelligence in college – Independent Tribune

Published

on



Duke University pilot project examining pros and cons of using artificial intelligence in college  Independent Tribune



Source link

Continue Reading

Trending