Man Buys Two Metric Tons of LEGO Bricks; Sorts Them Via Machine Learning

iStock // Ekaterina Minaeva
iStock // Ekaterina Minaeva

Jacques Mattheij made a small, but awesome, mistake. He went on eBay one evening and bid on a bunch of bulk LEGO brick auctions, then went to sleep. Upon waking, he discovered that he was the high bidder on many, and was now the proud owner of two tons of LEGO bricks. (This is about 4400 pounds.) He wrote, "[L]esson 1: if you win almost all bids you are bidding too high."

Mattheij had noticed that bulk, unsorted bricks sell for something like €10/kilogram, whereas sets are roughly €40/kg and rare parts go for up to €100/kg. Much of the value of the bricks is in their sorting. If he could reduce the entropy of these bins of unsorted bricks, he could make a tidy profit. While many people do this work by hand, the problem is enormous—just the kind of challenge for a computer. Mattheij writes:

There are 38000+ shapes and there are 100+ possible shades of color (you can roughly tell how old someone is by asking them what lego colors they remember from their youth).

In the following months, Mattheij built a proof-of-concept sorting system using, of course, LEGO. He broke the problem down into a series of sub-problems (including "feeding LEGO reliably from a hopper is surprisingly hard," one of those facts of nature that will stymie even the best system design). After tinkering with the prototype at length, he expanded the system to a surprisingly complex system of conveyer belts (powered by a home treadmill), various pieces of cabinetry, and "copious quantities of crazy glue."

Here's a video showing the current system running at low speed:

The key part of the system was running the bricks past a camera paired with a computer running a neural net-based image classifier. That allows the computer (when sufficiently trained on brick images) to recognize bricks and thus categorize them by color, shape, or other parameters. Remember that as bricks pass by, they can be in any orientation, can be dirty, can even be stuck to other pieces. So having a flexible software system is key to recognizing—in a fraction of a second—what a given brick is, in order to sort it out. When a match is found, a jet of compressed air pops the piece off the conveyer belt and into a waiting bin.

After much experimentation, Mattheij rewrote the software (several times in fact) to accomplish a variety of basic tasks. At its core, the system takes images from a webcam and feeds them to a neural network to do the classification. Of course, the neural net needs to be "trained" by showing it lots of images, and telling it what those images represent. Mattheij's breakthrough was allowing the machine to effectively train itself, with guidance: Running pieces through allows the system to take its own photos, make a guess, and build on that guess. As long as Mattheij corrects the incorrect guesses, he ends up with a decent (and self-reinforcing) corpus of training data. As the machine continues running, it can rack up more training, allowing it to recognize a broad variety of pieces on the fly.

Here's another video, focusing on how the pieces move on conveyer belts (running at slow speed so puny humans can follow). You can also see the air jets in action:

In an email interview, Mattheij told Mental Floss that the system currently sorts LEGO bricks into more than 50 categories. It can also be run in a color-sorting mode to bin the parts across 12 color groups. (Thus at present you'd likely do a two-pass sort on the bricks: once for shape, then a separate pass for color.) He continues to refine the system, with a focus on making its recognition abilities faster. At some point down the line, he plans to make the software portion open source. You're on your own as far as building conveyer belts, bins, and so forth.

Check out Mattheij's writeup in two parts for more information. It starts with an overview of the story, followed up with a deep dive on the software. He's also tweeting about the project (among other things). And if you look around a bit, you'll find bulk LEGO brick auctions online—it's definitely a thing!

Looking to Downsize? You Can Buy a 5-Room DIY Cabin on Amazon for Less Than $33,000

Five rooms of one's own.
Five rooms of one's own.

If you’ve already mastered DIY houses for birds and dogs, maybe it’s time you built one for yourself.

As Simplemost reports, there are a number of house kits that you can order on Amazon, and the Allwood Avalon Cabin Kit is one of the quaintest—and, at $32,990, most affordable—options. The 540-square-foot structure has enough space for a kitchen, a bathroom, a bedroom, and a sitting room—and there’s an additional 218-square-foot loft with the potential to be the coziest reading nook of all time.

You can opt for three larger rooms if you're willing to skip the kitchen and bathroom.Allwood/Amazon

The construction process might not be a great idea for someone who’s never picked up a hammer, but you don’t need an architectural degree to tackle it. Step-by-step instructions and all materials are included, so it’s a little like a high-level IKEA project. According to the Amazon listing, it takes two adults about a week to complete. Since the Nordic wood walls are reinforced with steel rods, the house can withstand winds up to 120 mph, and you can pay an extra $1000 to upgrade from double-glass windows and doors to triple-glass for added fortification.

Sadly, the cool ceiling lamp is not included.Allwood/Amazon

Though everything you need for the shell of the house comes in the kit, you will need to purchase whatever goes inside it: toilet, shower, sink, stove, insulation, and all other furnishings. You can also customize the blueprint to fit your own plans for the space; maybe, for example, you’re going to use the house as a small event venue, and you’d rather have two or three large, airy rooms and no kitchen or bedroom.

Intrigued? Find out more here.

[h/t Simplemost]

This article contains affiliate links to products selected by our editors. Mental Floss may receive a commission for purchases made through these links.

An Illinois School District Has Banned Fully Remote Students From Wearing Pajamas While Learning

The great thing about Zoom is that it's almost impossible for people to tell if you're wearing pajamas.
The great thing about Zoom is that it's almost impossible for people to tell if you're wearing pajamas.
August de Richelieu, Pexels

Having most of your interactions via video chat can be a little exhausting, but it does come with a few perks—like being able to wear your pajama pants without anybody knowing or caring. For students facing remote learning in Illinois’s Springfield School District, however, PJs are against the rules.

WGRZ reports that the dress code for Springfield’s learn-from-home plan includes a ban on pajamas, which a number of parents aren’t too happy about.

“I don’t think they have any right to say what happens in my house,” parent Elizabeth Ballinger told WCIA. “I think they have enough to worry about as opposed to what the kids are wearing. They need to make sure they’re getting educated.”

Aaron Graves, president of the Springfield Education Association, doesn’t actually appear to disagree with Ballinger.

“In truth, the whole pajama thing is really at the bottom of our priority scale when it comes to public education,” Graves told WCIA. “We really want to see kids coming to the table of education, whether it’s at the kitchen table with the laptop there or whether it’s the actual brick and mortar schoolhouse. Raising the bar for all kids and helping them get there, whether they’re in their pajamas or tuxedo, is really what’s important.”

Though the pajama prohibition was part of the regular in-school dress code [PDF], imposing it from afar will definitely be more difficult. Fortunately, the administration’s enforcement policy is pretty vague; a statement shared with WCIA explained that “there are no definitive one-to-one consequences” for wearing your pajamas to online school, and teachers will decide what to do about any given violation.

In other words, it looks like kids with easygoing teachers (and parents) will get to stay in their nightshirts, while others might have to learn their multiplication tables in tuxedos.

[h/t WGRZ]