Aaron's blog

Big RAM in a little server

By aaron.axvig , Fri, 12/05/2025 - 08:56

I recently purchased a used SuperMicro SuperServer E300-9A-4C because I had come upon a bunch of 64GB ECC RDIMM sticks from the e-waste pile and supposedly it could handle four of them.  This makes for a power efficient way to get 256GB of RAM in a homelab node, although it is a bit weak on CPU at 4 cores.  I would have preferred a SYS-5019A-FTN4 with 8 cores but couldn't find used ones for sale.

The used server from eBay of course did not come with a power supply so I had to order one and wait a while.  Finally that arrived so I stuffed in 4x Samsung M393A8G40AB2CWE sticks and booted up the Proxmox installer.  After a very long wait for memory training or something, it would get to the first screen where I could choose graphical or terminal install.  And then after choosing either one I would get the "Loading initial ramdisk" message and then it would freeze at a black screen.

Eventually I found some errors in the IPMI's Server Health Log.

Uncorrectable ECC @ DIMMB2 - Assertion

Sometimes it would be DIMMB1 too.  I swapped out both B1 and B2 and still had the same issues.  Then I ran the memtest86 program via the Proxmox installer's Advanced Options and sure enough it failed after less than a minute, right at the 130GB mark.

I swapped out for 4x 32GB SK Hynix HMA84GR7MFR4N-TF sticks and the memtest ran for a while.  Next I tried the Proxmox installer and that ran as expected too.

So 128GB of RAM in the system is good enough for me that I don't want to sink hours more into figuring out why the larger ones aren't working.  This has to be a very rare configuration for such a small server with low CPU power, so it wouldn't surprise me if there are hardware limitations.  Or I am simply not looking carefully at module speeds, timings, etc.

Homes in the Heartland: Balloon Frame Farmhouses of the Upper Midwest

By aaron.axvig , Fri, 08/01/2025 - 15:37
Date completed
4 months 1 week ago

This book seems to be THE resource on this era and locale of old farmhouse styles.  There is a ton of great info about the various types and in fact this is the only material I know of which has grouped them into specific types.

The book could be improved with more example pictures.

Completion status
Rating

The Rise and Fall of D.O.D.O. by Neal Stephenson and Nicole Galland

By aaron.axvig , Mon, 07/21/2025 - 08:12
Date completed
5 months ago

The overall premise of magic dying out for the given reasons is pretty clever overall, and the time travel mechanism/effects holds up to some examination.  I find the historical setting to be fun and pretty well detailed in this book.

The "found documents" format is tedious, and especially so for my eBook situation due to some formatting difficulties.  I think quality dropped a bit towards the end as some plot points became less plausible.

Completion status
Rating

Hatch Rest+ 2nd gen teardown

By aaron.axvig , Fri, 05/02/2025 - 16:12

Our Hatch Rest+ 2nd gen lost all battery functionality.  If lifted off of the wireless charging base for a fraction of a second it would die.  It was replaced under warranty, and customer support even saw the second one on the same account and said it would eventually develop the same issue.  So they replaced that one too!  Great customer service, which is really what is necessary to make the best out of what I'm sure is a bad situation for them.

Most exciting for me about the whole situation was the opportunity to tear apart the old one!

Tearing off the rubber pad on the bottom reveals some screws, and then the wireless charging module comes out.  Also found here are the barrel jack, and the power and sync buttons.

Here is the component side of the wireless charging board:

With the removal of the two middle screws shown in the first picture, the top of the cone comes off.  There are some tight wires.  The battery and speaker ones each have three wires and seemed to pop off easily.  The single wire is for the metal touch ring and I think I stretched that one to a damaging extent.  I didn't plan to put it back together though.

Access through the top is by prying off the speaker grill:

The speaker is held on by a few screws:

And within there is the battery:

The battery is a single 18650 cell:

It has a BMS.  The voltage directly on the battery was effectively 0V.

Now the main board.  This picture is after I had pried the SD Card out.  You can see that I damaged the card holder, but the card itself was fine.  Like many of the cable plugs within, it had a small dab of glue on it.

The SD card is 16GB and has a FAT32 filesystem.  I found about 7GB of mostly files on there.  Curiously, it seems to have all of the files for several Hatch products.  Folders include:

  • Rest_Sounds
  • RestMini_Sounds
  • Restore_Sounds
  • Sleep_Sounds

Another folder is named Downloaded and contains two interesting files.  BeRIOTGameMusicTTR_20220607.mp3 is an hour-long rendition of what I think is the Peaceful Flute music.  And RIOT_BrownNoise_CGV3_20240115.wav is a short clip of white noise.

Removed the plastic ring:

Here is the 7 segment display.  It appears to be individual LEDs behind 7 slots.

Here is the flip side of that main board:

Espressif ESP32-WROVER-E processor:

Tags

Run Your Own Mail Server by Michael W Lucas

By aaron.axvig , Thu, 04/03/2025 - 15:38
Date completed
8 months 4 weeks ago

I set up my own mail server about a year before reading this book so the timing wasn't great, but still this was a good read.  And fortunately I had chosen almost exactly the same software stack.

I will probably use this to go back through and fine tune a few things on my server...eventually.  The rspamd config comes to mind.  I don't think it is updating any definitions as I mark new messages as Junk.

This book was great for putting me to sleep.  But that's OK!  It probably isn't great to read something that amps you up and keeps you up.

Completion status
Rating

Distilled water maker update

By aaron.axvig , Fri, 02/07/2025 - 10:54
RO setup in laundry sink

It has been about two years since we purchased an entry level RO water maker kit (Aquatic Life RO Buddie 4-Stage Reverse Osmosis Deionization Water Filter System RO/DI Filtration Units for Aquarium, 50 GPD) to make "distilled" water for some ultrasonic humidifiers in our house.  This type of humidifier is capable of vaporizing the minerals in tap water which then deposit themselves in a thin film on everything in your house.  Using distilled water is hence required/recommended, and using RO water is good enough according to some people and to my experience.

So now two years later and a wild guess of 400 gallons produced, is it time to replace the consumables in my RO setup?  Here are the numbers:

In three minutes it produced 420ml pure water and 1450ml waste water.  Per hour that is 8.4 liters (2.2 gallons) and 29 liters (7.7 gallons).  Roughly 1:3.5 ratio which seems to be about expected.  I did the same calculations when new--of course I did not save them but from memory this was about the same.

Input water measures 279 ppm TDS and 4.3C temp.  Product water measures 0 ppm and waste water measures at 340 ppm.

My verdict: It is performing fine, I will replace the carbon and sediment filters as recommended, at a cost of $7 each.  Mainly this is to eliminate worry of chlorine damaging the membrane.

Some notes on the setup as seen in the picture:

  • The feed tees off of the washing machine supply line.  And the dryer tees off of it too so there is a lot going on there compared to the average washing machine!
  • The feed runs into a garden hose timer so I can set it to 45 minutes and walk away.  For the first year we had it connected to the faucet and would set a timer when starting it, so then have to go back and stop it.  This way we also have use of the sink.
  • The assembly is mounted inside of the laundry sink.  This way if something leaks there are decent odds that it will not be a house-flooding occasion.
  • Pure output goes straight into a watering can which we use to fill the humidifiers.  The waste line is tucked into the drain of the sink.

Update: after replacing those two filters, things seem a little worse.  In three minutes the numbers were 410ml and 1550ml.  I have no theories for this.  Certainly there is some measurement error but I think this would be at the upper bounds of error to be found in my methods.  So maybe.

Halloween candy

By aaron.axvig , Fri, 11/01/2024 - 07:32

We gave out fruit snacks, which came in a box of 160 packages. Each one contains a stingy 6 gummies.  When I counted this morning, 90 remained. We ate four last night, leaving 66 given to trick-or-treaters.

I ate two this morning while counting.

Mandan house trees

By aaron.axvig , Tue, 10/15/2024 - 20:40
Pickup loaded with trees

For posterity, here is a description of the trees that we planted in September 2021.  All were purchased from Prairie View.  I'll say they were fine but I'll check out somewhere else next time.  We went with fairly large trees and I think it was a worthwhile expense do to so.  They were all extensively watered for the first fall and then two summers.  I did almost no watering in 2024, which was helpfully a pretty wet year.

Boulevard Linden

We planted two of these in the boulevard at $327 each. These seem to be slow growers but I'm sure someday they will be mighty trees!  Just now in 2024 we finally see significant growth on the top of the north tree (more sun on that one since the south tree is shaded--my theory).  Info 

 

Medora Juniper

A sort of privacy screen is formed by these in the side yard.  $96.50 each.  These have been growing at a great pace and staying very shapely.  Water/ice falling from the porch onto one has not really harmed it so the hardiness is impressive.  Info

 

Dwarf Korean Lilac

Three of these serve as show-pieces at the very front of the yard.  I have been able to keep them trimmed in nice ball shapes.  Ideally these would be just big enough that they go just up to the sidewalk but not over the edge.  They have several years before that will be a problem.  These are grafted trees, $218 each.  The flowers only seem to last two days.  Info

 

Northern Empress Elm

This tree is in the middle of the front yard and has really started to nicely shade the porch area.  It has grown rapidly and has an impressive trunk.  Rated to grow 28 feet tall and 24 feet wide, it should not overwhelm the front yard.  It grows a ton of downwards drooping garbage branches so I get lots of practice pruning.  Apparently this was first available in 2021, the year we got it.  $312 for the pleasure!  Info

 

Hot Wings Tatarian Maple

I thought for sure that the leaves would be the hot-wings-colored part of this, but I see now that it is the seeds.  That does make sense, since the seeds (samaras, aka helicopters) are like wings, and that is what they say turns red.  $186 for this one.  It had 6 main shoots going straight up in a bundle for the first two years, and they were very annoying in the way that they tangled with each other, but now they have matured out to do their own thing and the tree looks good.  This one is in the side yard.  I imagine that people think it is dumb to put a maple tree right between two kind of close houses and with overhead power lines nearby, but this tree should only grow to 18 feet in both height and width so should fit nicely as a mature tree.  Info

 

Prairie Expedition Elm

A big tree for the big back yard.  Our neighbor Joyce has a nice big elm in her back yard and hopefully this one can fill in the skyline once that one has moved on.  This grows at a ridiculous rate, with many new 8' shoots each year.  They are too long and susceptible to wind damage so sometimes I cut the ends off.  This one was kind of a disorganized wreck when we got it, with a dead and sideways leader, so who knows if it will turn out to be a decent tree.  Maybe some good pruning tactics will become obvious as it continues to grow over the next few years.  Dutch-elm-disease resistant.  $280.  Info

 

Shrubs/flowers

Tiny Tortuga Turtleheads on each side of the front gate.  Mammoth Yellow Quill Daisies to the south of the gate.  Fulda Glow Sedum by the turtleheads.