Loomiere 2.0 teaser

[Update]
The new high is now ~2600 active streams, summing ~1500 Mbps of bandwidth. Some graphs:

• Network traffic (cumulated for all interfaces): https://www.bijk.com/s/7c52.png


• Active connections: https://www.bijk.com/s/0F48.png

---

This article is a quick peek into how Loomiere 2.0 is (currently) able to serve ~1700 active streams from a single server in production, summing up to more than 1100 Mbps of bandwidth.

All these statistics represent a single machine, in real time, over a period of 12 hours, equipped as follows:

• 2 x Xeon Dual Core (with HyperThreading) at 3.2GHz


• 16 GB RAM


• 15 x 1TB HDD (7200rpm)


• 4 x 1GB NIC's


• This system runs on Ubuntu 10.04.1 LTS.

OK so here are the graphs:

• Cpu load: https://www.bijk.com/e/812e


• Network traffic (cumulated for all interfaces): https://www.bijk.com/e/8423


• Active connections: https://www.bijk.com/e/AF6E


• Memory consumption: https://www.bijk.com/e/E379

The graphs are not quite stable at the moment since I am currently working hard to test this setup and Loomiere itself, but I think soon I will have a more stable configuration and also some time to comment on these graphs.

Enjoy your weekend!

P.S.: I love graphs :).

Loomiere/Stream: Revived!

OK folks, things have settled down and we are good to go. After some considerations the legal concerns for Loomiere/Stream are now cleared and gone. The source is now released and will be available indefinitely. Again, this streamer (minimally customized) has already been serving all the video content at http://peteava.ro for 3 full months (for those seeking a demo).

Source code: loomiere-0.2.1-tar.gz

Warning:
Any software downloaded from this website is *never* to be associated in any form with pornographic or erotic content! I.E. "Loomiere/Stream" must *never* be used to stream pornographic or erotic videos! There are plenty alternatives if you can't help it.

Just a teaser:
Fighting the video-streaming problem has taught me very many things which, in turn, led me to realize that I might be able to use a substantially different streaming approach to achieve a massive amount of optimization in this field. So quite soon, I think I'll have ready a brand new (and far more powerful) streamer that aims at making it possible for a single server to serve many thousands (I am still testing this) of streams simultaneously using commodity hardware. I am not yet settled on whether this project will be commercial, open-sourced or both but I hope to clear this aspect soon as well. Real-world streaming (i.e. before and after) statistics will be made available on release.

Stay tuned! :)

First impressions on Loomiere/Stream performance

As promised, here are some of the first monitoring statistics of Loomiere/Stream in a production environment after moving away from psstream. Only one server is considered, a Quad-core Xeon with 8GB RAM (not that they are used anymore).

This shows the memory usage over one week (the switch was made on the 29th as is obvious).

Loomiere/Stream - A high performance streaming server

UPDATE: The code is now freely available under GPLv3. Please see this post for an update.

ATTENTION: Due to the fact that myself and my company are not yet satisfied with some issues regarding the legal terms of Loomiere/Stream, I think it is wise to take it (temporarily) offline until we resolve our concerns! Also some of the technical characteristics have been retracted.

Are you killing psstream?

Well, yes! I am sure that many of you already know about psstream (the PHP streaming extension I made a while back). Well, many things happened since then and I came to realize I could do better; a whole lot better actually. As of now the 'psstream' project is officially no longer developed (see below). It will remain on the website for some time to come for archiving purposes but that is it.

But wait, why did you do it?

For some time now I have be looking into improving the streaming mechanism for a large video-sharing project run by my company. PSStream was a first effort, and it did the job but soon ran into problems. None of our servers was able to properly stream more than 150 clients simultaneously and the resources were grossly wasted, hence, Loomiere/Stream.