Sunday, June 12, 2011

BSDCan Trip Report: Simon Nielsen

The Foundation recently sponsored Simon Nielsen to attend BSDCan 2011. Here is his trip report:

My main goal of attending BSDCan 2011 and the preceding Developers Summit was "networking", talking in person to many of the people I normally only interact with via email or IRC. Both to discuss some of the many smaller and larger outstanding issues but also just to generally meet people and talk to them in person which always help working together in the future. This certainly happened both during the "work day" time at the DevSummit and conference, but also at other times like during breakfast, lunch, and dinner which was almost always done with other FreeBSD'ers.

With my "FreeBSD.org admins hat" I spent some time talking to Brad Davis and Peter Losher about ways to improve administration of FreeBSD.org systems in the future. Among the discussed topics were ISC's use of Kerberos which might be useful at FreeBSD.org and the Puppet system for system administration. Some time was spent talking with Mark Linimon and Brad Davis about future plans for the nyi.FreeBSD.org site. I also attended Mark's talk about lessons learned from the nyi.FreeBSD.org rollout to date.

The FreeBSD Security Team held an informal meeting during the conference where we discussed how to try and improve the workings of the Security Team which will hopefully stir things up a bit.

One evening we had a DNSSEC dinner where it was discussed how to integrate support for DNSSEC into the FreeBSD base system. The main goal was to be able to support DNSSEC verification in normal applications. It was discussed both at the API level (e.g. should applications be able to know about DNSSEC verification failures) and the system level on how to actually implement this in FreeBSD. The primary conclusion was that this needed to be built into the NSS system, and likely integrated with nscd somehow.

I briefly talked to Hiroki Sato about the possibility for setting up an IPv6 tunnel broker for FreeBSD developers as some can't easily get local IPv6 connectivity.

The ports developers have been talking about changing the version control system for the Ports Collection from CVS to Subversion. I had a few discussions in this regard about how to practically do this, including repository layout and a time limited svn2cvs.

During the DevSummit I attended the Ports Working Group where the future of the FreeBSD package system, including distribution, was discussed. I attended the working group both with my hat of FreeBSD.org admin and Security Team member. The discussions were very useful and a rough consensus was agreed upon both for the future of packages, where they can hopefully be a lot more useful, and for how to handle distribution. From the security perspective the proposed system will allow us to build security into the system in the future. The new package system, coupled with the proposed "package set" concept, will require a radically different way of distributing packages. We discussed a workable model where we move to a more centralized system with fewer but better nodes for distribution. This will also allow us to better utilize our current sites and possibly add other sites in the future.

For the main conference, the "BHyVe a Native BSD Hypervisor" presentation was very interesting both from a general technical perspective and because it might allow the FreeBSD.org admins team to run some virtualization of servers without having to run other operating systems as is required today. George Neville-Neil's "Synchronizing Systems on a LAN: An Introduction to PTPd" presentation was very interesting from the technical perspective in hearing about all the challenges of very accurate timekeeping. The talk also had a lot of audience participation from people who knew a lot about the topic which made it even more interesting.

My Photo Album from the trip is available here.

Friday, June 10, 2011

BSDCan Trip Report: Thomas Abthorpe

The Foundation recently sponsored Thomas Abthorpe to attend BSDCan 2011. Here is his trip report:

The first time I was privileged to attend BSDCan was in 2009, a generous sponsorship from the FreeBSD Foundation enabled me to attend. Of the many topics I could have reported on, I chose to identify the human aspect of FreeBSD, the people that make it happen, and why the Foundation sends developers to conferences.

To me, people are still the most valuable resource in the project. I have mentored in many committers to the ports tree, and at BSDCan 2011, I was pleased to learn that two of my mentees would be attending. Rene Ladan (rene@) and Baptiste Daroussin (bapt@) would be in Ottawa, and for the first time ever, I would meet my proteges face to face. Julien Laffaye had been collaborating with Bapt, and was here for the presentations. Our sense of camaraderie in IRC made the initial meeting feel like a well established friendship. Our travels around Ottawa became a standing joke, “A Canadian, Dutchman and a pair of Frenchmen walk into a ...”, from this you can make your own joke.

This year at BSDCan, the DevSummit was organised a little different than usuall It was done with break out groups forming into working groups and bringing together like minded people to get together and share ideas. As a porter, and member of portmgr@, my working group was the ports infrastructure. Erwin Lansing (erwin@), took the lead in organising this particular session, uniting porters and other interested parties. He asked me to deliver 15 minutes on the Licensing Infrastructure in the Ports tree.

Other speakers throughout the morning included Ben Haduk, presenting Athena Packing, Peter Losher from ISC with his wishlist for ports, and Will Andrew (will@) sharing his vision for ports. A brainstorming period was hosted by Erwin to illicit feedback from the crowd.

The particular, show stopping presentation of the day belonged to Baptiste Daroussin. Bapt, along with former GSoC student Julien Laffaye, offered to revolutionise the packaging infrastructure with libpkgng. Their reports will follow, I do not want to steal their thunder.

Suffice to say the morning session time that was allocated was not enough time considering the buzz and excitement around libpkng; an afternoon session was added to get all topic material included. More detailed plans were discussed on what would be needed to integrated libpkgng into the src base, along with feature requests and other tidbits of administrivia.

One thing that typifies our Information Age is electronic chatter. The hot topic of conversation during coffee and lunch was libpkgng; this was discussed face to face, in groups, and throughout IRC. There were even emails being circulated, particularly through the portmgr mailbox. A private conversation between Mark Linimon (linimon@) and Erwin declared that Bapt may be a valuable member on the
Ports Management Team, not just for his efforts on libpkgng, but for other ideas he has, including a new means of grouping OPTIONS in a port Makefile. The usual vote was held, and unlike the usual week to take care of business, within 24 hours the tally was in favour of adding a new member to portmgr.

Now that the vote was cast, all that remained was to ask Bapt if he was interested. For geographical reasons, this is normally done via IRC, but we had 3 port managers in Ottawa and this one could be done by an old fashioned press gang. It was agreed during the lunch break the three of us would sequester Bapt, and have the chat. Being the jokester that I am, I thought it would be amusing to instill Bapt with a sense of angst. In IRC, I told him privately that the two of us needed to have a “Man-toMan” chat at lunch. Grudgingly, he accepted. We met him in the hall, and we laid it on the line. Bapt graciously accepted and you can see it as YouTube's least viral video.

From this we had what I am told was a new record, 4 portmgr at one event. Not only was this worth celebrating, but was worth hosting an ad-hoc meeting. With the joys of modern technology, a video conference was setup with Florent Thoumie (flz@), Ion-Mihai Tectcu (itetcu@), and Martin Wilke (miwi@). Yet another first. In this meeting, we were able to share the success stories of the Ports Working Group, libpkgng, plus talk other business.

Every night after supper, I took the opportunity to return to the Hacker Lounge for a time of visiting and hacking. This was a great relaxed venue to just sit back and do as much or as little as you wanted! Human nature what it is, hackers in the lounge flocked together based on their commit bits, src guys there, doc guys there, and ports guys here. One could do an interesting sociological study in there!

Prior to BSDCan, I organised a Facebook event called “portmgr appreciation week”. This was a self serving event to encourage committers to close PRs, perform an act of hospitality for a portmgr or whatever people felt appropriate. Friday night a group of us brought beverages into the lounge and took up a collection. We declared this the “portmgr appreciation week donation fund” and turned over the proceeds at the Foundation Desk Saturday morning.

If BSDCan 2011 had ended on Thursday for me, I could still have considered the event an overwhelming success. But this was just the pre-conference, the real thing was to start on Friday! As usual Dan Langille and friends did a great job organizing the event.

With some assistance from my portmgr peers, we composed a little thank you to the FreeBSD Foundation for their generous grants which brought us together. I would personally like to thank the Board for this wonderful opportunity to be able to travel to Ottawa and participate in this year's BSDCan.

Wednesday, June 8, 2011

BSDCan Trip Report: Sergio Ligregni

The Foundation recently sponsored Sergio Ligregni to attend BSDCan 2011. Here is his trip report:

The travel started at Mexico City's International Airport, flying to Montreal and then to Ottawa.

The first day of BSD activity was Wednesday, May 11th, when the FreeBSD DevSummit took place at the University of Ottawa. We arrived, got our badges and started discussing development stuff. I was invited by Robert Watson to the Capsicum DevSummit. Unfortunately he was not there in person, instead of that, we talked to the Watson Box (Robert via Skype); I think this will remain famous through the years.

The DevSummit was interesting. It was my first Summit and I thought it would be like other conferences but with more participation from the audience. I was happily surprised when I found that there were opinions and really technical discussions on how to follow the development of the Capsicum framework. Pawel Dawidek explained how he performs some process "jailing" and how Capsicum is helping to achieve his goal, but also what he does not like too much and some ideas how to improve it. I felt surrounded by really serious security people, like my mentor in GSoC 2010, Stacey Son, who I finally was able to meet in person.

After that Summit I had the opportunity to talk to Dru Lavigne and ask her some final questions before taking my BSDA Certification Exam, like if it is needed to know all about the four BSDs regarding the certification goals (the answer: yes!).

In the second day of the Summit, Justin Gibbs gave a FreeBSD Foundation Report. I learned how the Foundation helps to spread the word on FreeBSD by sponsoring events and attendees. I analyzed that there's a gap in the Latin America area (north and central). I asked Justin how can the Foundation help to get a BSDCon in Latin American north area (since there a couple of events in South America). I think that Justin's answer changed the purpose of my trip to Ottawa: "the FreeBSD Foundation would help to get a BSDCon there, but we need a local contact to organize it". I started thinking on a next BSDCon in Mexico that covers the Mexico & Central America area.

The seed is set, it's just a matter of getting the elements to bring BSD to Mexico. I decided to give my mobile phone a better use than texting friends and I started interviewing people, important *BSD people, like:

* Michael Lucas - BSD books author
* Pawel Dawidek - FreeBSD commiter
* Stacey Son - FreeBSD/TrustedBSD developer
* Matt Olander
* Dan Langille - BSDCan organizer
* Brett Davis - iXsystems sales manager (I am trying to get more FreeBSD users by letting they know they will have strong support services)
* Dru Lavigne
* Josh Paetzel - FreeBSD developer (iXsystems)
* Julio Merino - NetBSD developer
* George Neville-Neil

The goal is to let the Universities know that *BSD is serious, in order to get some sponsorship and a venue. Also to let the company managers know that the OS is not only a learning OS or a hobby. BSD can be used in a really serious way and it is not just saving money, it's about investing in improving the product and giving back to the community.

After the FreeBSD Foundation report, I saw how FreeBSD is "cooked". I was in the "kitchen" looking at how the new ideas and features are discussed, and the greatest part: once the board is full of items, it is time to assign them to the developers. I'd like to say "me" next time I am there. I want to be more prepared as I know there is a release in 4 months.

The first day of the BSDCan conference was on Friday. I was a little nervous since I was taking my BSDA Certification Exam in a couple of hours. We started with a talk about UNICS in an architectural view. It was more than the non-technical view of UNIX development and it was fun and interesting to hear that from someone that actually lived it.

Then I took my certification exam. I asked Dru how many BSDA certified professionals are out there and it was great to hear that more than 150 professionals are certified. I think, however, we need to keep pushing to get more people certified. I can speak from my experience that the test is not impossible, but it really tests you. I found it really interesting, actually. I am still waiting for my result and hope to pass the exam.

I attended some other conference sessions at BSDCan, both ones where I know about the topic and others where I didn't know it actually existed. It was great to meet such professionals and to learn about new features.

Some of the talks I remember were the Kris Moore talk about the new PBI format for PC-BSD/FreeBSD. I think that will help newcomers to get involved using the system by its simplicity but at the same time its robustness. Also, Josh Paetzel's talk about a project I am currently working on, the new installer pc-sysinstall. It felt great to know that my code will impact a lot of systems.

There were these talks of previously unknown but interesting things: like the new SQL for monitoring systems and the Superpages for memory management. I found those really interesting and will read and digest their papers.

About the conference: I can say that I met great and interesting people and became curious about a lot of stuff. I am willing to get a project finished and present it to the community at a future BSD conference.

I also have a lot of materials to start moving things in Latin America, such as the videos I recorded. There is already a guy in Mexico that started the FreeBSD community and its website. BSD is getting stronger here: in the last Latin American Open Source Install Festival, PC-BSD was the second most asked for OS. I am sure that with a lot of effort, the help from the community and Foundation, and a little bit of luck, we will plan the next Mexico BSDCon. I talked with a guy in the hostel about the conference I was attending and the plan to get one in Mexico, and he proposed SalsaBSDCon. I think that name is great and will help attract people here in Latin America. I think I can help to bring BSD to Mexico even though we are "so close Berkeley, so far BSD".

Monday, June 6, 2011

FreeBSD Foundation and iXsystems Announce IPv6-only Testing Versions of FreeBSD and PC-BSD

The Foundation is pleased to announce that Bjoern Zeeb has made good progress in the Improved IPv6 Support project and that testing snapshots for both FreeBSD and PC-BSD are now available in time for World IPv6 Day. From the press release:

The FreeBSD Foundation and iXsystems announced today their commitment to support the efforts of World IPv6 Day to accelerate global IPv6 deployment. Earlier this year, the FreeBSD Foundation and iXsystems jointly awarded Bjoern Zeeb a grant to create an IPv6-only version of the FreeBSD and PC-BSD open source operating systems.

FreeBSD is well-known as a network stack research and reference platform and its KAME-based reference implementation appeared over a decade ago. With the help of the community, FreeBSD has been serving releases from IPv6 enabled servers for more than 8 years and FreeBSD's website, mailing lists, and developer infrastructure have been IPv6 enabled since 2007. FreeBSD is used by critical Internet infrastructure such as root name servers, routers, firewalls and some of the world's busiest and most reliable web sites. PC-BSD is a complete desktop operating system, based on FreeBSD, having the casual computer user in mind.

Bjoern Zeeb explains the work as follows: "Similar to many modern operating systems, IPv6 in FreeBSD was an optional feature that implied IPv4 support. Since most "IPv6-ready" applications rely on dual-stack behavior, broken IPv6 support often goes unnoticed given the IPv4 fallback option. Providing an implementation of an IPv6-only kernel without IPv4 support provides the FreeBSD Project with the ability to test and fix such regressions while encouraging other software developers to improve their code for true IPv6 readiness. With PC-BSD serving the desktop community and FreeBSD targeting the server, infrastructure and embedded markets, we have created an ideal development and test platform for other open source and proprietary IPv6-aware application software."

Kris Moore, founder and lead developer of the PC-BSD Project notes that "PC-BSD, with its FreeBSD base, makes an ideal platform for the testing of end-user desktop applications and utilities in an IPv6 environment. We are proud to be able to offer an IPv6 desktop testing environment for World IPv6 Day."

FreeBSD testing snapshots are available here and PC-BSD testing snapshots are available here.

Thursday, May 26, 2011

BSDCan Trip Report: Daichi Goto

The FreeBSD Foundation recently provided a travel grant to Daichi Goto to attend BSDCan and the FreeBSD Developer Summit. He has provided the following trip report:

What have you accomplished by attending this conference?

I have written thirteen BSDCan 2011 related articles for the "FreeBSD Daily Topics" section of gihyo.jp. The articles describe BHyVe, virtualization, FreeBSD on Amazon EC2, BSDInstall, PKGng, tool-chains, PCI Express hot-plug, Chromium, UFS2/SUJ, GEOM performance, and FreeBSD vendors. Articles will be posted one per day and the complete list can be found here.

I will also write about the new features of FreeBSD 9 and 10 for the MYCOM Journal and about IPv6 and HAST for @IT. Both are major Japanese IT news sites and the articles will be written in Japanese.

What did you learn by attending BSDCan and the DevSummit?

Many many things. BSD Hypervisor BHyVE and virtualization situation are very hot. The FreeBSD DevSummit is a great opportunity to get fresh FreeBSD news and developers thinking. I was able to travel with my mentor, Hiroki Sato, from whom I have learned many things. I also learned new things from the IPv6 tutorial attendees and other FreeBSD developers.

Thanks again to the Foundation for your support!

Wednesday, May 25, 2011

FreeBSD portmgr thank you to the FreeBSD Foundation

The FreeBSD Ports Management Team wrote a thank you note to the Foundation for providing travel grants to several developers who therefore were able to attend the very successful Ports Working Group session.


We would like to publicly thank the FreeBSD Foundation for granting Baptiste Daroussin and Julien Laffaye a travel grant to travel to BSDCan 2011 for the Ports and Packages Working Group held at in Ottawa last week. The working group itself was a huge success and a number of improvements with regard to automated binary package creation and distribution to ease upgrade procedures for our users were discussed and will hopefully be implemented over the next few months.

None of these improvements, however, would be possible without a long overdue rewrite of the package tools provided by FreeBSD. Over last few years, a number of attempts were made to enhance the current tools, but none have been as all-compassing as the PKGNG project by Baptiste and Julien. The presentation given by Baptiste at the packages summit and summariszed at the DevSummit track of BSDCan showed a comprehensive new tool that can completely replace the current tools, and provide a clear migration path from the old to the new tool. It also provides a large number of new features while keeping the old ones and is a lot more flexible to be able to add more features later. As you may have heard, Baptiste has also joined the ports management team as a result of his efforts.

Thanks again to the Foundation for sponsoring Baptiste, Julien, Simon Nielsen (Deputy Security Officer) and Thomas Abthorpe (Ports Management Team) who all were instrumental into making the ports working group such a success.

Monday, May 23, 2011

libcxxrt C++ Runtime Now Available Under BSD License

The FreeBSD Foundation and the NetBSD Foundation announced today that they have acquired a non-exclusive copyright license to the libcxxrt C++ runtime software from PathScale, a leader in high performance Fortran, C and C++ compiler products for AMD64, Intel64 and MIPS. The press release, available from the FreeBSD Foundation, Pathscale, and PRWeb websites, is as follows:

The FreeBSD Foundation and the NetBSD Foundation announced today that they have acquired a non-exclusive copyright license to the libcxxrt C++ runtime software from PathScale, a leader in high performance Fortran, C, and C++ compiler products for AMD64, Intel64, and MIPS. This software is an implementation of the C++ Application Binary Interface originally developed for Itanium and now used for the x86 family by BSD operating systems. Libcxxrt will be available under the 2-clause BSD license.

This implementation is a full replacement for the GNU libsupc++ library for platforms that use the Itanium C++ ABI, including i386 and x86-64, and will replace portions of the C++ stack previously only available under the GPL. It provides implementations of the dynamic features of C++, including dynamic casting, exception handling, and thread-safe static initializers, and will continue the gradual replacement of GNU toolchain and runtime components, furthering the aim of a purely BSD-licensed system.

"This work complements other work done in the community and is a further step in letting us adopt alternative toolchains in FreeBSD," said Robert Watson, a FreeBSD committer and Director at the FreeBSD Foundation.

"There are already a number of STL implementations with other licenses, but libcxxrt is the missing link for a BSD licensed C++ compiler and the C++ runtime," said NetBSD developer Joerg Sonnenberger.

"It's great to work with the BSD community and help provide these core parts of the toolchain," said Christopher Bergström, CTO at PathScale. "This is a first step to PathScale offering first class support for both NetBSD and FreeBSD."

About The FreeBSD Foundation

The FreeBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting the FreeBSD Project and community. The Foundation gratefully accepts donations from individuals and businesses, using them to fund and manage projects, sponsor FreeBSD events, Developer Summits and provide travel grants to FreeBSD developers. In addition, the Foundation represents the FreeBSD Project in executing contracts, license agreements, and other legal arrangements that require a recognized legal entity. The FreeBSD Foundation is entirely supported by donations. More information about The FreeBSD Foundation is available on the web.

About The NetBSD Foundation

The NetBSD Foundation is a 501(c)(3) non-profit organization dedicated to supporting the NetBSD Project and community. Under its education and research mandate, it supports development of the NetBSD operating system which supports over fifty different computer architectures from a single, unified set of kernel and userland source files. The NetBSD codebase is used by commercial embedded developers, educational institutions, and individual end-users. Through donations received from individuals and corporations the Foundation is able to fund substantial work undertaken by developers. More information about The NetBSD Foundation is available on the web.

About PathScale

PathScale Inc. has developed industry leading high performance Fortran, C and C++ compiler products for AMD64, Intel® 64, MIPS processors and provides support to users desiring the highest level of performance from their applications. The PathScale EKOPath Compiler Suite has the world's most advanced optimization infrastructure and can fully exploit the potentials of many-core architectures. The company’s goal is to deliver robust and high performance compilers tailored to clustered, GPGPU and multi-core computing environments. More information about PathScale is available on the web.