This is not a ‘stack’ it is a demo app for a bunch of Azure features
> This project is a proof of concept. It is not intended to be used in production. This demonstrates how can be combined Azure Communication Services, Azure Cognitive Services and Azure OpenAI to build an automated call center solution.
Indeed. I’m the project creator. That’s standard legal notice we must add to these kind of “large” repos. If not a dev team should maintain it full time with security incidents response managed within a SLA, which is not the case there. The same project is working in production for a few customers.
Is there an English demo?
lmao
For people unfamiliar with this area: you can do all this with AWS, and have been able to for a while now. I left the industry a few years ago, but at the time people were still waiting for Microsoft's response because Amazon were clearing up in the cloud contact centre space.
The problem with modern LLMs and AI expectations in this area is that 99% of call centre calls can typically be handled with a basic yes/no/"get your answer from here instead" type response and deflections that doesn't need really fancy AI.
"Well great, LLMs can deal with the really hard 1%" - nope, they're the high value, big impact issues that you want your best remaining humans to handle and learn from to feedback into the business.
Interesting. Can you share a link to the AWS call center stack?
https://docs.aws.amazon.com/connect/latest/adminguide/what-i...
It's really interesting to mess around with if you're familiar with AWS and don't know anything about what goes on on the other end of a call with a business.
Lots of cool party tricks from it.
Literally the only reason in want to ring a call centre is because the online forms got me nowhere, the “press 1 for…” robot got me nowhere, and I’m desperate to speak to someone sentient, even if they are just reading from a script.
At least for Microsoft, having an AI voice reading from script would likely be an upgrade. I’ve called Windows support a couple times, and half of the time the Indian accent on the other side was so thick I couldn’t understand a thing (and the 4kbps audio quality and call center noise didn’t help either).
This will be an absolute game changer in the phone call scam space. AI scams were already a thing, but now Microsoft made a proof of concept to replace their custom, terribly constructed software.
- [deleted]
I cancelled my Airtel Boradband and moved to a local provider just because Airtel implemented AI Bot, and its impossible to talk to a human.
Automate outgoing call. Get a record of your voice. AI synthesize your voice. Call your family members in your voice, in distress. Scams of biblical proportions will happen in 2026.
If I were running an offshore call center (or writing software to support them), I’d be sweating bullets, right now.
This may not be the thing that kills them, but it’s only a matter of time.
This is also entirely predictable. We’ve known this was coming, for at least two years.
It already sank their revenues in the past decade as 'support bots' were a thing before chatgpt but now it's far better, for some definition of better. But all services I used before 2020 already had 'chat bots' and that killed very many call centers / revenue then already and that's accelerating now. Now you can (for some definition of 'can') instruct the llm to ONLY escalate when nothing else works which enables many companies to get their in house staff to handle those few.
As someone who has been literally involved in this business (AI support), not very successfully unfortunately, I wouldn't.
They're literally the best suited companies to take full advantage of this new technology!
They have existing customer relationships, training manuals, past call recordings (== training data), and enough humans for fallback / oversight (often legally required!)
But yeah, you have to continue being entrepreneurial or risk being replaced by being complacent
Thanks for the perspective.
You make good points. You know the managers for that industry, better than I.
If you are confident that they will get on the new wave, then I stand corrected.
I just posted this a few days ago, but the corporate people at the top won't look at it from a technical perspective, I'm sure. They'll look at how much they can save the company by quicky implementing the latest & greatest AI solution and lay off the people working there.
>> It has gotten to a point that the use of AI has turned life into a literal Kafkaesque nightmare. How soon will AI take the place of customer service for actual necessary services like calling your local DMV to make an appointment or even taking over 911 services? The promises made by AI companies about this software making our lives easier has merely become a drive to implement AI into every possible facet of life, not to benefit anyone, but to drive up profits.
Full post/context: https://news.ycombinator.com/item?id=45708816
Thanks.
Some of those examples are depressing (but also, very human).
Can I also get the analogous code for an AI customer navigating the AI customer service to get to a human customer service?
Like anyone else I am also annoyed by customer service experience over the phone. However if you're on the other side of CS calls you'll notice so many calls that are for simple things that the user could easily do online. Those trivial calls takes the time from CS representatives to address more important queries. If AI CS is done right, it would be mostly a filter for helping human CS folks only deal with real issues rather than "how do I log into my account? I'm on your blog page..."
The solution to that problem is for an ISP or provider to have a better website with, attention now, less marketing spam that confuses their customers.
If the website had a clear priority on discoverable FAQs that wouldn't be an issue. But most of the time these types of websites don't care about these issues and tutorials on how to use their systems and services, at all.
Throwing an LLM onto a problem like this, which requires a good knowledgebase to begin with, is just a plain stupid idea. It will make things much worse, not better.
You would like to think so.. but you are already on one side of the bell curve. I ran an isp in the 90's. Literally "have you checked if the computer is plugged in" is a conversation I have had.
It isn't because of "marketing".
> If AI CS is done right, it would be mostly a filter for helping human CS folks only deal with real issues rather than "how do I log into my account? I'm on your blog page..."
You're right, but AI isn't needed to do this - just a competent call centre manager who watches the analytic and has control of the menus and messages.
The "real issues" that remain after the easy ones are filtered out probably aren't the issues any company would want to leave to AI anyway.
My ISP is xkcd806 compatible, although I’ve never had to invoke it.
If the AI had a similar mode that would be reasonable.
I had a similar issue talking to AT&T recently. I should have asked for someone with a stuffed penguin on their desk...
https://github.com/microsoft/call-center-ai?tab=readme-ov-fi...
One annoying part of the new AI world is these worthless AI-generated diagrams. I don't mean AI generated the pixels, I mean it was asked to generate docs, maybe even a "system diagram", and the result is just noise.
Funny because I written them myself at the time. Last year they were no really useful AI like CC!
Is the call worth making if it is not worth answering?
If the internet didn't exist this would be incredibly useful. Call the cinema to find out when the movie is playing, call a company to find out their refund policy and get troubleshooting steps for their products, etc.
Now I prefer to get this information from websites. But there is still a chunk of the population (mostly the older half) who prefer calling over websites, and maybe that's true even for these chat bots
Yes. The alternative these days is often a maze of a phone menu. If I can just say my issue in complete sentences and the AI routes it appropriately and otherwise acts on it as I want, that's pretty good.
Then the AI misunderstands you and you end up in a loop of autogenerated responses, or just a "please visit our website for this inquiry."
You used to be able to break of of clothing calls. DHL refused to deliver a parcel of paid for next day delivery on, and sent an automated email saying “phone us to pick it up at depot”
Phone them and the only options were to get that information - no way to find out what depot it was at or how to collect it.
DHL now in the “do not use” file, but that only works when my supplier gives a choice, and is only relevant when all delivery providers are not identical.
I play a looping mp3 of "agent, advisor, assistant, human" when on a robocall and just wait for it to pipe me to a person. Talking to an AI is beneath me.
I'm sorry, I don't understand, please state your issue in complete sentences. You can say things like "help placing an order", "track my order" or "check inventory stock"
That's the old speech recognition stuff that just matches keywords. LLMs can infer what you want pretty flexibly.
I mean yeah if it's a bad model then it will be bad. If it's good then it's good. It's not like getting hold of a human in the call center guarantees anything either. They can be pretty useless too.
> If I can just say my issue in complete sentences and the AI routes it appropriately and otherwise acts on it as I want, that's pretty good.
I fear that it is not used for routing, rather used for completely replacing the real person.
- [deleted]
I wonder how many risks there are with prompt injections and "social engineering" with these. If you were persistent enough how long would it take to trick it to give you some information it should not. And would company even monitor for that?
I work on building a support system right now at my job and this is the point I've been trying to make for the past few months. No, the AI chatbot should not have access to sensitive customer info. But our product manager is all-in on the hype and sees this as something that "deal with" later on.
Oh well, who cares if there's a breach, some idiot gets to put a shiny AI product on their CV and get that new promotion/job. Users be damned.
While so far automated customer service has been pretty bad, I can see why nobody wants to actually take the calls. There are some real rage-beast assholes out there. Blame them for ruining it for everybody.
Plenty of people still want to keep their customer service jobs. I have some fond memories of my time doing customer support when people were genuinely grateful for my help.
The rage-beast problems are exacerbated by companies designing their support system so that human operators cannot take a lot of reasonable decisions and risk losing their job getting someone involved who might. You can easily end up frustrated and angry if you need to call five times a week to get a basic request handled because the four people before you couldn't get it done and had to rush to take the next call. Call center companies are placing down human shields around their probably-illegal pricing systems and profit margins.
Yeah I definitely want to speak to an AI bot when I've just been in a car crash. /s. There will be a place for this though, for people who either can't afford or don't want to pay for better.
On one hand this is lovely code and seems to work well, on the other hand there are currently estimated to be 2.86 million call center staff in the US alone.
Project creator there. The biggest challenge in marketing this project to potential customers is not the fact that it does not work well, but the unions and human problems. It really marked me.
Did we really let customer service get so bad that people think this will be an improvement? My gut feeling says this will not transform companies who are bad at customer service to improve, rather the ones that are already bad are now just bad with a lower headcount. Curious to hear any positive expectations for this.
In my experience, there are two types of customer service.
One is the type where people are working to actually help the customer and the rep is authorized to take whatever action necessary to accomplish that goal.
The other is the type where the rep has no authority to do anything. They'll endlessly transfer the caller to another rep, make them wait, transfer again, make up excuses for why nothing can be done, and just do what they can to goad the caller into consenting to giving up, absolving the company of having to pay anything or provide any sort of service.
I don't think number one will be replaced by AI. I think number two will be replaced by AI.
The choice between 1 and 2 is entirely at the hands of the company management, with their choice usually going towards 2 as it is cheaper.
Having had to interact with it, AI customer support is about as horrific as you'd expect. Hallucinating policies, hallucinating that they've provided a refund without actually doing so, etc.
But it doesn't really matter what "people" think. Corporate sees a way to save money by employing less people, customers be damned. Sadly customer service does not seem to have any bearing on a company's success, considering Google is successful as it is when it literally does not offer any kind of customer service at all.
I was personally designing and building these systems for FAANG like companies a few years ago.
Lex was the state of the art for these sorts of systems at the time.
These newer LLM based systems won't be perfect, but they'll be 10x better at free form intent recognition, and significantly less repetitive and robotic for menus and similar. I suspect the agent experience when you get to a human will be far more comprehensive, enabling real human agents to be just a little bit more helpful sounding.
Realistically though, anything that could be used to improve agent or callers experience in these environments will be squeezed and stretched in the name of profit to the point where both parties suffer.
There will be none, people will be sick of AI Bots and would always prefer to speak to a human
Nowadays I make baby like noises until the AI gives up and routes me to a human, if I am lucky, there are services that just and simple hangup.
> Did we really let customer service get so bad that people think this will be an improvement?
Yes.
One of the things that I learned, early in my career, is that the best customer service, is good product design, obviating the need for customer service. That’s something within my control.
For many companies, post-sale customer service is a money sink. I remember being told that the margins on a product were so thin, that a single call from a user would wipe out the profit.
But I was also never given support to produce a decent UX, because that was expensive.
Damned if you do[n’t].
s/bad/unavailable
Remember humans? So inconvenient.
Curious about the future where customers are also AI.
The already entrenched classes solidified with none ever having to interact with each other in realspace and hemmed into their places by terminators?
Gives a whole new meaning to "I'm from Microsoft and your computer has a virus!"
if my ISP refuses to hire a human for customer service I will just replace it
Great! Now we can disrespect our customers at scale!