22 Feb 10 Call Analytics – Beyond CDR analysis – Part I

“Oh, just get me the CDR’s and I’ll take it from there” – how many times have I heard these words before? I can’t even imagine the number of times in the past 15 years of IT/Telecom’s work that I’ve done and in the last 8 years of Asterisk in particular – when it comes to billing and fraud management, it would appear that the CDR’s are the Rosetta Stone of the industry.

Over the past 6 months, several of my friends and I had been asking ourselves this question: “Is there more to billing, fraud management and profit leakage? does it really all begins and ends with the CDRs?” – so, here we were, a group of 3 engineers dealing with telecom system and billing systems – we knew that the answer is a definite YES, however, how come most companies and system aren’t even aware of this, in such a way that causes them to leak telecom profits and waste their hard earned profit margins on simple accidental mis-interpretation of CDR records.

So, we’ve decided to sit down and start analyzing calls in real-time, trying to evaluate not only the CDR record that is received upon the completion of the call – but also understand the traversal path of the call, analyzing it in real time and evaluating it profit leakage potential. At the mean time, we’re concentrating our work on Asterisk, as it is the simplest for us to implement – however, we’re not focusing it only on that – we’ll looking at adding it to FreeSwitch, Yate, OpenSer/Kamailio, OpenSIPS and the various varients.

So, what have we done so far? well, one thing we never really had with any of the existing systems was a clear view of what’s going on “right-now” on our systems, so we said: “it would really be great if we could know how many call hits we’ve received during the past 15, 30, 45 or 60 minutes” – so here is what we made:

The above image shows our top 10 inbound DID numbers, as you can see these are in the 972 and 447 country codes (yes, we work mainly in Israel and the UK). At the backend, our servers are analyzing the data in real time, generating an active alert in the case a DID number’s statistics change in a somewhat drastic change, thus, establish a traffic anomaly. Another thing that interested us was our usage across multiple servers, which we are exhibiting in the below graph:

Now, as you can see, the top graph shows a discrete anomaly:

This anomaly indicates something went wrong on all our servers between 00:45 and 1:15, which gives us a fairly discrete period of time to seek for a problem in the system. What happened was that one of the guys updated a portion of the data traversal API – basically deleting it [we resumed full work after about 40 minutes].

So, where is it all going to? well simple, a new Open Source based service that we’ll be launching within a few months from now. Our intention is to provide a means for simple, straight forward, highly reliable, call analytics, fraud management and profit leakage analysis service. A service which is based upon a simple to use API on one hand and Open Source based data gathering agents. Our belief is that by analyzing large amounts of data, from multiple sources around the world, we’ll be able to ascertain the fingerprint of a telecom bound attack – being able to alert the respective users of the service and maybe in the later future, also provide a means to block the attack as it advances across the world.

I’ll be updating about our advancement as we go along, but for the time being, this is something I felt would interest you.

Tags: Application programming interface, Asterisk, Israel, opensource, Real-time computing, Rosetta Stone, Site Management, Statistics

03 Dec 09 I’m not rude, I’m eccentric

Today I got the chance to speak at a Polycom half-day convention, mainly to speak about Asterisk and HDvoice. Now, putting aside the part about HDvoice (I’m getting a post about that on its own), I gotten to the point where I believe that I’m currently perceived as being an eccentric.

So, why am I eccentric? very simple, I’ve reached a point where I can say things that may be perceived as rude – and write it off an being an eccentric quirk.

I’ve talked about Asterisk ability to support Video, while the current Polycom VVX1500 video phone isn’t yet supported at its fullest. One of the people in the crowd mentioned some sleezy,al-cheapo, SIP Video phone (to be more exact, he’s the local distributor) – and I claimed that I don’t count that phone as a comparison to Polycom or other VoIP Video phones, simply because in my view it’s not a worth while comparison. Comm’on, let’s be realistic, can you compare a Polycom VVX1500 (an HDvoice Video phone) with some shitty sub-VGA SIP Video phone from China? the mere comparison is simply insulting for Polycom.

Shortly after negating that phone, the person stood up and left the room. At the break, a friend said to me that I shouldn’t have said that, in order to come out the bigger man. Common, the guy is surely making a joke of himself. I commented: “I’ve said what I said, I stand by my opinion – besides, you know I’m eccentric – eccentric people say eccentric things” – he agreed that I’m eccentric, after all, you can’t be an Open Source evangelist without being an eccentric – now can you?

Tags: Aastra, Asterisk, Business, GPL, Grandstream, GreenfieldTech, Huwaei, open source, Polycom, Session Initiation Protocol, SIP, Skype, Telecommunications, Video, Voice over Internet Protocol, VoIP

15 Oct 09 Astricon 2009 – Glendale, AZ – Part II

Ok, it’s day 1 (or actually day 2) for AstriCon 2009 – and here’s my report for the day.

Yesterday was kind’a of a hectic day for me, as I was teaching a full day track of Asterisk and Cloud Computing, specifically, implementing Asterisk systems with Amazon EC2. I started the day with a class filled with 20+ people, and ended the day with a similar number – so in general I’m very happy. Not many people tend to attend the pre-conference days, so having that number of people and their positive reactions through out the day were very reassuring to me.

If there is one thing I’ve learned from this experience, it is the following: If you give a full day track, don’t arrive at the hotel 24 hours prior to it – you need at least 48 hours! People didn’t really notice (I hope), but through out the day I was suffering from a splitting headache – one that would usually send me right into bed with a couple of Advil’s. But hey, that didn’t stop me and I powered through it, I’m fairly proud of myself for doing so – as at the end of the day I regained back my strength and was livelier.

Today was the first official day of the conference – I gave the opening talk for the Cloud Computing track of the day. My talk was about how to build “IP Centrex” like services, without building an “IP Centrex”. I guess that I didn’t really introduce a brand new concept, but actually talked about something that many are thinking about, but are not inclined to try it on their own and burn some cash on. I guess my talk helped them out saying: “Hey, we’re not talking out of our asses here, this guy makes some sense and what we thought of isn’t that far fetched”.

Previous to that, Digium announced the 2009 Digium innovation award winners, where my company won an award in the pioneer category. This is the second year in a row my company had won the award, and I’m really happy with being acknowledged for this specific work. Having being a part of the community for over 7 years now, this award, at least to me personally, says a lot – it’s basically saying: “Look, you’ve done good, you’ve done some work that really helps out the project and the community in general – here’s a beer and a toast to you – hip hip” – well, that’s kind’a of a mouth full, but you get what I mean. I think that this is actually the place to mention that the award was for developing a high-powered Dialer/IVR platform, used in the Israeli elections and the work was contracted for a company called Shtrudel.

The all conference party is tonight – so I better rest up and be ready for it – should be fun. I guess beer and food are always a good mix when a bunch geeks are getting together

Tags: Amazon, Amazon EC2, Asterisk, Business, Cloud computing, digium, EC2, GreenfieldTech, Innovation Award, Virtualization, VMWARE

19 Jul 09 A baby, a house and a full time job

For those of you who know personally, you probably already know that last month I became a father. I guess the transition is something that I was more or less ready for, at least on the technical terms of the transition. However, the thing that completely surprised me was the mental transition – which isn’t even related to the somewhat lack of sleep here and there.

So, here I am, about a month and half away into the final touches to our new home, spending the weekend deploying over 100 meters of CAT-5 cabling in the house – yes the house is network rigged to the teeth. I’m sitting in my daughters room, clamping away the wall sockets for the network, thinking to myself: “hmmmm…. will Nitzan need a single network connection? or should I put at least two for future usage? … hmmmm…. well, I guess time would tell”. In any case, so there I was, spending most of my weekend being my own geeky self, thinking about wiring, networking, wireless exposures, access points, etc. I then go back home, and suddenly, all that disappears the minute I put Nitzan on my shoulder to burp her. It’s really funny, but with her on my shoulder, I guess everything goes away for a few minutes. My brother-in-law informed the house that he caught me burping Nitzan, while sitting at my computer answering emails with the other hand – Ok, so I can’t stop being a geek all together.

In any case, here I am juggling the various aspects of being a father to a new born baby, attending to the various tasks required to final touches of the house (painters, cleaners, air cons, dry walls, etc) and of course, attending to my customers – some of which are completely ambivalent to the fact that I’m under a constant lack of sleep in the past month. Well, I guess in a couple of months Nitzan will start sleeping better, and would make life easier for both me and my wife; in the mean while, we take comfort with the sleep periods my wife gets during the day, so that I can work and cater to my customers, while she caters to Nitzan during the nights – and I have to be honest about this, when it comes to the baby, my wife is the closest thing to a Jedi Knight, her ability to stay focused and clam even when the Nitzan is screaming is amazing – I can’t always do it.

Ok, enough about the house and Nitzan, let’s go back to been geeks for a bit. As you can see on the right hand side of the blog, I’ll be speaking at the up-coming Astricon. I’ll be giving a talk about how to build “IP-Centrex” like installations, utilizing Asterisk and tools like VMWARE, XEN and OpenVZ. However, while my talk may be interesting to you (I hope), my pre-conference tutorial will be much more interesting. I’ll be giving a full day tutorial, teaching people how to install Asterisk in a clouded environment (cloud computing), mainly the Amazon EC2 cloud computing infrastructure. For those of you reading this blog, you may have noticed that I’ve developed a distinct interest in the Amazon EC2 cloud, which I’ve written about several times and also lectured about at Amoocon. While my Amoocon presentation was mainly informational, at Astricon I’ll be primarily teaching you how to do what I did. Well, I won’t be teaching you the inner workings of the GreenfieldTech IVR API framework, although, if you’re gonna ask questions I will answer (especially if you ask the question 3 times, I can’t stand it when people ask the same question 3 times – I just have to answer it – nudge nudge).

Ok, back to fatherhood and Nitzan stuff. The mental transition that I was referring to before is something that I felt last night in its most force. My wife and I decided to go to one of the malls, not far away from our house. So, we entrusted Nitzan with my in-laws and drove to the mall. The mall I’m referring to is called “The seven stars mall” and we like it. It’s not a big mall, but its got this shop called DOMO, that carries these high class cooking ware (my wife and I really like to cook – my chilli con-carne is well known). So, here we were walking the mall, after I ordered a pair of shoes that I needed. So, my wife comments: “You know something, let’s see if there is some sale at Super-Pharm.” – and then we ended up purchasing baby formula, pacifiers and baby wipes. I then asked my wife if she maybe wants to walk into DOMO, but we both didn’t really think about it – suddenly, something that was like a default prior to Nitzan is no longer a default – interesting isn’t it?

In any case, this is how my life looks like at this point in time – and I have to admit that I kind’a like it. Sure, I don’t get as much sleep as I got before, but hey, I’m happy with it – so I just keep on smiling and go on forward.

Tags: Amazon EC2, Amazon Elastic Compute Cloud, Application programming interface, Cloud computing, File sharing, Google, Microsoft, Pirate Bay

19 Apr 09 Asterisk Fax, Cheap VoIP Providers, Free Calls and more …

As I recently explained to a good friend of mine, the essence of Jewish holidays is, more or less, the ever growing consumption of food – due to our great fortune with people trying to kill us and not being able to do so. Putting that aside, now a days, the essence of Jewish holidays, at least in Israel, is to basically sit at home and do nothing.

Last week was Passover. For those not in the know, Passover is the weird Jewish holiday when we’re not allowed to consume any bread or bread like products. On one hand, it reminds us our ancestors who travelled the desert for 40 years, and had to leave Egypt in a rush, so their bread didn’t rise. So, we eat Matza Bread to remember that time. However, today, you can make bread from a multitude of other ingredients, not only White Flour. For example, you can make bread from Potato Flour, Soy Flour or even Rice Flour – in other words, anything else by White Flour. I’m confident the orthodox Jew will claim that I’m wrong – but hey, that’s my 2c on the matter. In any case, Passover started on the 7th of April, and lasts 7 days. The first 2 days and the last 2 days are national holidays. So, the only work days that remained were: 9th, 12th, 13th. The 9th was a Thursday, no use working for one day, 12th was a Sunday, most of my customers abroad are not working, 13th was a Monday – hence – a single day of actual work to do. For a workaholic, like myself, that is more or less a nightmare.

VoIP Providers

Recently, a post on voip-info.org had caught my eye:

• 2009-04-15 - VoIP Providers Ranking AZ-VoIP-Providers publishes latest International Top 10 VoIP Providers Ranking on 15-April-2009.

I’ve decided to visit that website and take a look at the providers the “so-called” list offers. So, in general, the site is nothing more that a so-called “VoIP Link Farm”, promoting some services over others. In general, the site only contains some logos of service providers, a shit-load of Google banners, and some poor content relating to the actual pricing of the service providers – in other words, nothing new. So, if you’re looking for the real thing, stay away from this site, there is nothing special in there.

Digium Releases Fax for Asterisk

Per Digium’s website, the Digium Fax for Asterisk is:

Digium's Fax For Asterisk is a commercial facsimile (Fax) termination and origination
solution designed to enhance the capabilities of Open Source and commercial Asterisk
as well as Switchvox. Fax For Asterisk bundles a suite of user-friendly Asterisk
applications and a licensed version of the industry's leading fax modem software from
Commetrex. Fax For Asterisk provides low speed (14400bps) PSTN faxing via DAHDI-
compatible telephony boards as well as VoIP faxing to T.38-compatible SIP endpoints
and service providers. Licensed on a per-channel basis, Digium's Fax For Asterisk
provides a complete, cost-effective, commercial fax solution for Asterisk users.

Ok, Fax is one of the most anticipated parts that Asterisk had been in need, since the creation of Asterisk. While back in the days of SpanDSP and Hylafax you were able to go about and send/receive faxes, in a somewhat reliable manner (who am I kidding, it was only 80% reliable), Digium’s Fax for Asterisk is surely a new step-up. This new add-on shows that Digium is maturing, becoming increasingly serious about their approach to the Enterprise market. I’ve been working with the FREE Fax-For-Asterisk license, which provides a single license and I have to admit – it works fairly well (what am I talking about, currently, 100% of faxes pass through without a hitch!).

New blog – The GreenfieldTech Blog

Well, after working on my own, for a period of more or less 2 years time – I’ve finally expanded GreenfieldTech. GreenfieldTech now enjoys 2 distinct divisions: the telecom division and the web analytics division. To read more about it, you’re welcome to visit our new company blog at http://blog.greenfieldtech.net/

Tags: Asterisk, Fax, Free Calls, GreenfieldTech, Jewish Holidays, Passover, providers, Scams, SpanDSP, VoIP