stargrave’s blog


Archive for the ‘Common’ Category

Free software in real business

Sunday, November 15th, 2009

Preamble

There are many “theoretical” talks about how free software can be used commercially, that it can greatly stimulate business activity and so on. There are very few real life examples of that. And most of them, as I can see, firstly had just common classical proprietary model of software development and only later some of them either freed their products or at least opened. As I can understand, only after fear of competition had gone they tried to made timid steps to open-source (as nearly none of them really understand difference between open-source and free software (as most of users too)) just to seem good and king in society’s eyes.

Now I want to tell you some kind of so-called success story of one company (where I work nowadays): company that chose freedom path as a base for software development. Actually it does not specialize itself on software, but on high-performance server solutions and storage systems manufacturing.

The first step that is troublesome

In all innocence first time we met need to develop own software — it was as common classical proprietary non-free closed-source product. It was some kind of firmware for brandmauer/router based on free software project — m0n0wall, licenced under 2-clause BSD. This licence allows (being not copyleft) one to make proprietary derivate works — that was crucial for us.

There were many features added to it (good thing there weren’t either serious security issues or bugs), but because of our fear to “shine” with it we decided not to communicate with foreign developers anyhow. Also there were licence’s ambiguities with remaining different included software.

And what is the result? Of course we gained some money from selling it, but not because of users willing to buy exactly it, rather because there was not any acceptable choice for them: cheap server meant to be brandmauer with plenty of useful abilities is sold only including our proprietary software.

Freedom run

During high quality granted server’s manufacturing we have to test all hardware components separately and all of them together in the whole system. Besides there must be firmware upgrade process (motherboard BIOS’es, BMC’s, hardware RAID-controller’s firmware, etc) and operating system installation automatization. All of these is needed to remove human factor as much as we can and to complete orders in time.

So we needed very complicated all-time progressing hardware testing system. There appeared Inquisitor software project, actually with roots going much deeper in time. Decision about it’s freeness was taken without a peep.

What benefits we got? Let’s look:

  • There was no need to pass over copylefted software used in it, to think much about “defending” from ones eyes it’s source code and so on. Only about licence compatibility, but that is another question.
  • We actively collaborated with different foreign free software projects related to our system. All community benefits. Willing or not we were software testers also, as many software provided needed features only in non-stable versions.
  • Our subproject — Einarc was helped much by totally independent from us people. You know, no one can have great quantity of different RAID-controllers and enough time to “play” with them.
  • We avoided possible unethical situations when someone will steal source code to use in own creations. Copyleft protects our freedom and possible losing courts.
  • Money? We did not loose anything even if the project will be closed. In most cases one will hire our team to configure and install this complex system to fit employer’s requirements. Someone can say, that raw source code is useless without corresponding team.

What disadvantages has Inquisitor being free software? None!

Crisis-driven development

But as we all know there appeared world economic crisis. There, in Russia, it should be destructive for high technology fields, as as a rule they cost too much to afford. Actually it was so of course.

That time we thought about how can we lower our expenses. As software developers, we decided to throw out proprietary very expensive network attached storage’s (NAS) software and to replace it with cheaper or priceless (freeware) one.

Moreover, there were other disadvantages in those proprietary NAS products:

  • We had our hands tired to be able to modify these software to better fit with our servers. To make it’s performance higher at least.
  • User can only use those features that already were built-in — there was no way to advance them, remove or add another ones.

We can not sell NAS-related storage server without that software and no user will buy it, but both of us have to pay for it very high price. We tried to find replacement for it: there were enough very different free and open-source software solutions, but none of them satisfied us (only technical reasons). We decided to write own one and of course release it as free software.

We have got what we wanted and even more:

  • We do not pay for each copy (or even terabyte, quantity of connections or users, and so on, as proprietary men do) or of NAS software.
  • We achieved wider range of hardware RAID-controllers support using already known Einarc utility.
  • We can lower expenses more by replacing these proprietary incompatible hardware RAID-controller by well-known proven and mature software RAID solutions.
  • We greatly helped (actually driven by ourselves too) Einarc project and as a result Inquisitor platform too.

User has got also several benefits from all of this:

  • Lowered cost on storage servers.
  • User is independent from RAID-controller vendor by using software based arrays.
  • We can modify NAS software as user wants.
  • Possible beginning of this shared software usage by other companies will lead to increasing competition on this field for cheaper and higher quality solutions.

We are satisfied, consumers satisfied — can it be true that everything is fine? Of course no: those proprietary software producing company, that do not care about user’s freedom, concealing everything it can, forcing everyone do what it orders without sidesteps, willing only to retrieve everything from others pockets, is not satisfied at all. It is unethical and immoral to be like these companies and one
can not consider them as an alternative.

Conclusion

As I tried to show you, free software really and successfully can be used in commercial. Of course it is not so easy, but whole humanity benefits from it except money-willing individuals. And even during economic crisis it can help to survive on the market.


Sergey Matveev (software developer at ETegro Technologies)

Thoughts about ISPs, privacy and GNUnet

Saturday, September 5th, 2009

Preamble

Nearly a week ago I discovered that all BitTorrent downloads from PirateBay did not work. Everything seemed fine - PirateBay website worked perfectly, torrents can be downloaded without any problems. But pings to PirateBay’s tracker did not work at all. DNS gave correct results, but packets were dropped. Using traceroute I understood that my ISP was dropping them - packets did not try to exit even to M-IX (biggest Moscow Internet Exchange).

From co-workers I discovered that European “big” and “important” men were going to punish every european ISP that will provide access to PirateBay (tracker). I checked half a dozen of other Moscow ISPs and they were dropping everything going to PirateBay’s tracker too.

I thought - “What a hell are they doing?”. I feeled myself like poor sheep among wolves. I pay them (not a low price) for real Internet access - not for a pack of services they like and decide to make available.

Guys from PirateBay are clever: one of them opened a simple pure BitTorrent tracker (OpenBitTorrent) and they added it to all torrents as an alternative. I switched it in my BitTorrent client and everything began to work fine again.

Thoughts

But that forced me to think about what will be if someone “important” (of course this “important” and “big” men are nothing more than a simple moneylovers) will found “enough” arguments to close even legally clean (IMHO) OpenBitTorrent. Of course there will appear yet another tracker, and another and so on - but it is completely unnormal: rich men dictate us, what we can use, download, watch and so on.

Is there anything that can protect us, protect our privacy, give freedom at least in Internet? I know about Tor onion routing existence - I run router all days long giving away all available bandwidth. But it can not help protecting torrent-index sites (such as PirateBay), can not protect Tor’s exit nodes. There are powerful lawyers group that are ready to protect exit nodes’es rights and so on - but I am not sure if they can do something in countries like Russia or anything else with their rotten law structure. And even if all of them will lead to successful courts - it will take really much time for a single judge process. Time is expensive. And except it: many people related to law will work with a lame, foolish, totally dependent on money things - unneeded society layer of people, waste of time and money, junk.

I thought that a possible solution can be: running BitTorrent tracker, torrent-indexing website as a Tor’s hidden service and forcing all clients to use SSL. That will fully hide BitTorrent server-side and will make inability to understand what each client is doing.

GNUnet

But… is there any more beautiful solution. And solution that can prevent the single known real possible attack on Tor’s network - traffic and network analysis. If we have got one hundred computers and no traffic among them at all, and several minutes later we discovered new Hollywood blockbuster torrent on a hidden torrent-index website, then we can understand possible server’s location through heavy network analysis. Or maybe possible leechers of course. It will gave only a prediction of target to police to check user computer’s contents. I think that it is not enough to activate police forces, but it is possible, because all of them love money and will do any dirty job for them.

After some searching, I discovered several network systems such as Freenet, Mixminion and GNUnet. From technical, privacy and anonymity point of view - GNUnet is the best choice between them. It protects content-uploaders (anonymity), content-retrievers, searches, search results and even network activity (permanent traffic load with an encryption) and makes strong protection from spying (inclusion of “bad”, “rich men”’s nodes into network).

Do not understand me incorrectly: it is not an advertisement or some kind of it of GNUnet, but rather mine wish to share excitements and feelings about it.

Building of latest source code on my MIPS-based notebook finished without any problems. Configuration for single daemon is very simple. GNUnet has classical true UNIX-way command line utilities to work with: one for searching - simply just enter search keywords, one for downloading - just enter an ECRS path, one for publishing content - it is rather simple too. Of course it is not full list, but it is basic tools for fully anonymous, without any censorship, saving your privacy sharing.

GNUnet can use not only ordinary UDP and TCP transport protocols, but also HTTP (with ability of proxying) and even SMTP one.

I read a lot about GNUnet and disappointments about it: searching goes too long, downloading too. I decided to share several gigabytes of content and to try my friend search it and download. I expected much more lower download rates and bigger search time, but everything was too fine: only a half a minute or maybe a minute for searching and about 10-20 KiB/sec download speed after the very beginning of it. Possibility to “thread” downloading (opposite to Tor - only single TCP connection) from several resources and swarming after that. So, theoretically it can be as fast as BitTorrent.

I want to show people that ISPs are too dependent on “big” rich men dictating all rules of their behavior. We are suffering from it, but we can prevent it. The already made solution for file sharing with full anonymity, privacy and without damned censorship exists. GNUnet is more than a file sharing system it can be base for many other services: SMTP, HTTP, IRC, VPN (AFAIK) already can be run on it. Also, there is a Tor system, but sometimes it is not enough.

We can stand against rich men and we can save out freedom. All the tools needed for it exists and they are working: not theoretically, but practically. The main problem with GNUnet is only a too small number of people using it - so let’s share!

Provider tried to deny access, because of Tor

Monday, April 6th, 2009

Here is a storyline of incident with me. When some day, my ISP - Infoline decided that I am contract’s violator, because of providing my Internet access to third-party (that is not true). Saying that it is about my huge number of connections. But I know, that it is because of acting my computer as a Tor router. And nothing is illegal there.

2009-04-05
At 21.00-22.00 I discovered that my ISP blocks access to Web. All HTTP-requests have been redirected to own page with the following content:

Dear subscriber, Infoline company informs you, that Your actions are unlawful. With reference to contract about providing Internet access with single login and password You provided access to third-party.

Dear subscriber, Infoline company informs you, that You are illegally using access to Internet. Please leave a request, to create a contract for legal using of provided service.

Also, there was a remark that I can ask any questions to Infoline’s support center. I called them. Call agent say that it is true, it is not a mistake, I have got too much traffic (while having unlimited by traffic tariff plan) and connections from my account. It can be caused either by virus-software or by providing access to third-party.

My answer, that I have got free GNU/Linux operating system (so no virus-software) and I did not share Internet access with anybody, except my own notebook, did not make any sense. In result, with tremulous voice, call agent as fast as he can say “Goodbye” to me and hanged up the phone, making no possibility to me to say any word. He said that after 24 hours, access will be granted again, and I must cure my computer from viruses and to repair my hardware.

All right. ISP blocked only Web. I can use everything else and Web via Tor network. So, the work can be go on.

2009-04-06
I called support center again. Hoping that anybody will give me detailed answer about why did they block me. The only section in contract that I could infringe is about providing access to third-party. I wanted to hear that there were too many PPPoE sessions with my login/password, or there were too many connections to different Web-sites. Nothing. They could not say how it determines multiple connections (from muliple users). They said that it is their own developed system, they can not describe it’s work and it can not make any mistakes.

After returning from work (after 22:00) I found my Internet is fully working. So… I am waiting what will happen next.

2009-04-12
Yet again. ISP blocks me again. And again after 21.00. I wrote them email describing all previous situation. Asking, why are they violating contract and imputing me in that. I wanted to see all objective submissions. Also, I called their support center and asked how long as a rule they answer on an incoming email. They guaranteed 24 hours. Ok, so I waited.

2009-04-14
No answer. I decided to write them again, writing that they did not respond my previous email and that I want to add some thoughts. I thought that they determining multiple connections by looking at several TCP connections to different HTTP-servers for a very time period. I described them, that I am using Tor software, that is just a some kind of transport level layer router, and it is absolutely normal that it can cause hundreds of different HTTP-connections in a second. Nothing from my side violates any contract’s clause.

2009-04-15
At morning, I recieved an email from them. They asked me about my login. Really, I forgot to specify it. But is it too hard to find me out using name and surname from sended emails? Short answer from me, specifying it.

2009-04-17
Yet again - no answer. I called support center again, asking why did not they answer emails. Answer was very simple: 24 hours is a time to consider an incoming email message. Nothing more. It can be answered from 2 weeks to 2 months. What a hell! Am I supposed to be banned again and again during several weeks? I am angry. Searching for juridical consultation office and for a new provider.

2009-04-18
Decision to change provider. Infoline does not want to answer any questions. The new chosen ISP is Cinet. It provides much higher speed via Ethernet and cheaper tariffs. Going to their office and asking their specialist about possible problems due to big number of connections gave positive results. And also they provide free (no price) connection to them, if I am going to them from another one.

Studying in an institute

Sunday, March 22nd, 2009

Studying in Moscow Aviation Institute I meet with different lecturers, different sciences and of course different software. As most of lecturers are quite an old men, some of them do not know computers and computer’s software and some of them know only that, what were introduced in Russia in the middle of 90s. Where PCs became accessible for people. Of course nearly all of this computers run Microsoft’s operating systems, such as Windows or DOS. Of course people did not know anything about free software, “alternative” OSes and even Windowses quite good. And of course nearly everything was stolen, was free (priceless). The bigger part of engineering and scientific programs in our institutes was created on that PCs with illegal Windowses.

Today, great quantity of works, tasks, etc for students are in need of computer and in need of those old programs. Many of them are lecturer’s property - their own creations. And everything of this can cause many problems for a man trying to use, support only free software. Some lecturers give their programs with all corresponding source code (as a rule it is Fortran programming language). The other part of them gives only binary/object code and deny giving it’s source code, as, as they say, it is very hard to understand and is very important and expensive intellectual property. And the other one uses scripts for MatLab, MathCad and force to use this products. Also, many of them demand to use Microsoft Office Word’s format for all reports, Excel for building graphs and AutoCAD for drawings.

It is very hard to study in such environment. Most works I can complete using free GNU Octave instead of MatLab, Maxima or SAGE instead of MathCad, Gnuplot for building graphs and QCad instead of AutoCAD and assure teachers that there is no need in proprietary, expensive, unreliable software and I can successfully use the free one instead. I can say that I have got no money to purchase most of this software. They can give it to me, but nearly all of it requires Microsoft Windows to work. Problems can appear even when teachers give task itself… again in closed proprietary Word or MathCad format. They can refuse to talk with me, because I deny using of proprietary software on my computers, I can not afford it, I do not trust it and in best case I forced to run it in virtual machine or separate computers, because I have got valuable documents and information on my PC. And currently I am not talking about the ethical and social aspect of such doings: only about price, safety of my information, compatibility with other software, legal use of it (I do not want to be offender).

Instead of learning, much deeper diving in science, I have to listen how to do something in expensive non-free software and simultaneously learn the free alternative of it at home (actually I like it, but it takes much time). And then, I must prove that work’s results are correct and full. And, by the way, I have to take notebook and show my work on it (if paper printings are not enough) - as teachers will deny installing the free software, they do not know and do not want to know. And they can not accept that student can use the really hard and serious programs (OpenFOAM for example for aerohydrodynamics computing). And in other case I have got big problems with the teacher and have to show my work to the other one.

But hopefully something becomes good after all this stories. People, seeing those rejections, hard positions, begin to think about the cause, they begin to answer why are you doing so, what is the problem. They discover the free software existence and it’s benefits. People begin to think, think about their future. They are not calculation mechanisms anymore, they are thinking creations - people - from the lecturer’s view. And after several years of studying I see progress - recommendations and offers (by teachers) to use OpenOffice, Maxima and LaTeX for example.

PS: Today I discovered DreamSpark project of Microsoft. It’s aim is to freely give different software (including Windows OS itself) to students. It is terrible. They are openly forcing students (and future workers, users of proprietary software) anyhow to use their products. Also they force students to register in their Windows Live service. On their site I saw many student’s competitions. I (as a student) was very interested in that, interested in competition’s reports. But… everything is available only in OpenXML-based Office formats. Looking on other links I found student’s “success” stories. There and there (in russian). I can not believe in such delirium, I can not believe are there really exist people who can believe in them? Are Microsoft Office’s users/student are so silly? I was shocked.

Thoughts about mass media

Saturday, March 21st, 2009

There was an article in “Komsomol’skaya pravda” (”Komsomol’s truth” - popular newspaper in Russia) about cyberterrorists. There are several interviews with different people about what “hackers” can do, and are they really so dangerous and can they destroy nearly the whole world’s infrastructure and so on. This article was one of the silliest thing I have ever read. I think it was really exciting for people uncommon with computers. I wanted to close this dull newspaper, but noticed small frame with Richard Stallman’s photo. It said that movie’s computer “hacker” has a real-life prototype and it is RMS. At the beginning of 90’s RMS declared a war against Microsoft, cracked different software-related sites and distribute it for free. I was shocked! I know history of free software movement, about GNU and RMS not so badly. I have never heard such lie, especially about him. I decided to search for something similar. Where did they find information like this? Without success. When I saw that people can leave comments on an Internet site about this article. To my surprise - already there were several dozens of comments not about a whole article, but about Richard Stallman-related remark. They asked authors of this article to explain what a hell are they writing? I left comment too of course. Several days later they disappeared. I and many others left another ones again - they were all deleted too. We promised not to take this newspaper anymore and to advise others to do so. Author - usual worker of this company, usual company producing shitty papers with a huge quantity of lies. Either they are too stupid to write something more clever than such creations, or they are too smart and understand that most people will never know the truth. Most people will be afraid of “hackers” (I use doublequote to show that, of course, I know who the hackers are; in the article’s context they must be changed to crackers), will be afraid of potential security risk for everything and will listen to “proven” safe giant corporations like Microsoft or Apple. Today everyone in Russia know that nearly all public, popular newspaper lied in nearly everything serious in Soviet Union. As I can see - nothing is greatly changed.

Simultaneously with discussion about that lies, I will mention about the meaning of word “hacker”. At the beginning, it meant something like “A person who enjoys exploring the details of programmable systems and how to stretch their capabilities, as opposed to most users, who prefer to learn only the minimum necessary.” (taken from Jargon File). But, as I remember by reading many related things, some journalist used this term for one security breaker. And other ones (journalists) began to apply this word for them too. And, today nearly all people know them as “hackers”, instead of “cracker”. And who done that? Who destroyed the normal original meaning of this word and link it with the bad guys? Again those stupid damned journalists and article writers of mass media newspapers.

Once, I with my friend took a place in a competition to create some Internet project. Many journalists and a TV were there. After the short ceremony they took a little interview from us. They were asking questions, on which I was giving descriptive understandable answers. I was looking after what did they write in their notepads. Nothing! They just shaked their heads and made thoughtful faces. They began to write something after my friend started to use beautiful, but without any meaning and explanation, words such as “oriented for a big public”, “easy to use by everyone”, “simple, reliable and fast”, and so on. Only those words without anything like “wiki engine” (it will say much about the project), “standards-complaint” and so on. Journalists simply do not know those words, so why did they came to this meeting? To get their poor salary.

Russian’s cellular network “Mobile Tele Systems” also has similar stupid phrases on their advertisements. “Operator of reliability”, “Operator of new ideas”. What a hell are those “new ideas”. Do they invent GSM or SMS? Or what are they talking about? Actually they are not so bad in quality of service, but one day I had to stop using it, because they forced people to use proprietary software to see monthly statistics (RARed PDF file).

Their job is to create sensations, to force people to discuss nonexisting problems. I won’t forget many years discussing subject about USA on the Moon. That there was no any Moon-landing of USA spacemen. Honestly, some time ago I hope that is was true, but I understand that I was too silly. There are many well-known, reputable and very clever people in space field in Russia. As I live in a city where the Soviet Union’s cosmonautics was born, and study to create spacecrafts I met many of them - all of them are sure about landing on the Moon. Sure, that it definitely was.

Several days ago there was a TV program describing some ultimate innovative liquid. You can sink any metal to this liquid for several minutes and it will be protected from corrosion for ages. Half and hour and no describing how can that be. It is total physical delirium. People do not know anything about wetting and corrosion processes. But several thousand people already believed in that and run to purchase this wonderful liquid.

Large Hadron Collider was nearly finished. Press begin to print hundreads (thousands?) articles about the future catastrophe, that we are all going to die, about black holes and so on. Everywhere people talked only about it. Bought tones of paper to read more opinions of different “scientists”. Yet another food for journalist, people that can not do anything else, except talking about junk, lies, stupidness, lies again.

Where is really important news, for example about Pirate Bay’s trial? About who will win: fat, dirty, moneywilling entertainment industry that bought nearly everything or justice, battle for freedom, clear mind, progress? It regards to everyone - it is hope for bright right future with freedom and independence from guys with exploding money bags.

And everything won’t be so bad, if… if people will listen to someone else, instead of those journalists. You can try to explain that journalist’s “hacker” is cracker and RMS was not breaking sites to steal software. Nearly all of them will shake head and escape from you as fast as he can, or will say something like “I think that you do not know history good enough”, “You are wrong. Look - the newspaper is telling…”, “Everyone thinks that it is so, and only you are not accepting that.”, and so on. Nobody listen to well-known spacemen (Grechko for example), engineers who build spacecrafts.

Sadly…

Defendant Internet, get up!

Friday, February 20th, 2009

The judicial proceeding is going in Stockholm above the Pirate Bay,
the biggest filesharing service in Internet.

It is not judging of Pirate Bay, it is judging of the whole Internet.
It does not suit the entertainment industry’s (EI) world, because Internet
is too wide, so is too independent. It does not fit in their tables of
debit and credit and also in a whole world’s picture existing in their
tight heads.

It is judging of modern advanced technology, above which EI can not get
on. Torrent-tracker provides ability of instant worldwide file sharing,
but EI is still in separated world of grannys and grandpas, where the
bottle of kerosene was locked in sched. Everyone who uses, for example,
Transmission or Azurerus know what a great abilities this programs
give. They can recieve huge quantity of files, they can share them
(moreover, this two processes is associated together, so you can not take
without returning back). Everything in this complex technological segment
is very harmful, from the EI’s view, as it does not provide profit for
them. They want to roll back the wheel of time, to find themselves in
happy 50s, where noone, like Internet, can not interrupt their routine
clicking of arithmometers, making money on music and movies selling.

Pirate Bay baffled them. They do not know what to do. 25 millions of
people share files, and EI dazedly look on it, embarrassedly murmur
in a court: because of Pirate Bay, we can not provide legal content
distribution using torrents for money, because of them doing this for
free. And what? Tomorrow I will go outside and begin to give everyone
my purchased books. So do I have to be in prison, because I am mining
bookselling? If there will appear a millionier with free benzine, so
does he has to be in prison too, because of mining others, that takes
triple price for it?

Two models of world meet face to face on that proceeding: paid and
free (gratis). Paid one judges free one, underdeveloped and advanced.
Cash desk judges double core processor with three levels of cache
memory. Guys in limos judges three young men with notebooks and brief
cases. Bookkeepers judges Internet, because it is not a trading counter.

Thus, what is happening in Stockholm is a proceeding between capitalism
and futurism, between masters of Earth and Internet’s community. It
is nothing for that masters that they ruined Earth, turning it to
dump on graveyard, that they created town’s industry of destroying the
nature. Now, they climbing to Internet to make a money making machine from
it. They carry an old junk, inheritance of Adam Smit: rate of profit,
income ratio, gross domestic income, tax and so on. Trade barbarians
crashes into thin world of digital communications with a club of
copyright, hoping to drive in naughty in trade ghetto.

No way! Internet is a gingerbread man, that escaped from granny of
capitalism and grandpa of totalitarism. Internet is not capitalism or
communism, it is not an american elective democracy or russian’s vertical
of power, it is totally something different. It is an environment,
where engine consists of free communication and tollfree sharing. Let
the poor EI tries to set up customs in the sky and to bottle oceans with
beautiful labels. Internet will survive this process, EI, and even the
state, that one pretty day, driven by progress, will move to virtual
world and disappear there.

Author:
Alexey Polikovsky (original is written in russian)
Translated by:
Sergey Matveev (aka stargrave)