Skip to main content

Thought 59: House of Cloud Pi: Part 3

Continuing on the House of Cload Pi.

This though is about the software and how to get it setup and going at least for getting things staged

YOCTO

Being familair with Yocto from other projects, this seems like a good place to start. It means dropping the ease of Raspbian Lite, but adds the customization and flexibility we are going to need to make this work. So, first Task is to get a basic image for a pi3 or pi zero w and then we can work from there. We will be following this toturial to get started at getting a basic setup for a PI. We should be able to add recipes and modify from there. Yocto can also be configured to create cross platform SDK's which will be useful in early development.

SWUpdate

After getting a basic image down we should attempt to get some level of updating system in place for the pi in the field. We are not going to be able to simple remove/replace and SDCard easily if there is a pi stuck some where in a wall or too high, so having a method of updating would be good. We can follow this example and hopefully not run into any snags with the setup. Once here we should be able to start building out new recipes. Ideally setup with a A, B image and leave more space available for dataspace, as we will be storing metrics and camera data or joining all of the data section as a clustered drive.

B.A.T.M.A.N.

This should be down in two stages, the first is as raspbian to get an idea on how well it will work for the needs. First follow a toturialrecipe. Then see if there is a recipe for yocto out of the box or not, if not we will need to create one. Set this up and hopefully get to the point where we can take a blank pi drop in a sd card with the image and have it join the mesh network, this will be a big giant step to make things work correctly. Likely we will need to create a few images here, one for the gateway and multiples for the end points like a pi zero w and pi 3 and pi 4, etc so we can drop and go with a network.

Base Software

If we get through have a drop in mesh network and upgradable image, we can now start down the path of adding software to networks.

    Base Software
  • GCC - Everything needs GCC
  • OpenCV, GPIOD, IIO, etc. - Libraries for interfacing with all of the hardware.
  • Node Red - A flow controll system.
  • Influx - For storing time series values.
  • Grafana - For viewing data on the devices.
  • Nanite - Personal flow library
  • Other, not entirely sure what all we will need to make this work, but we can figure it out and add it all to the receipes.

Distributed Software

With a base setup going, it will be time to start harnessing the power of having all of these networked devices. So let's look at some packages that might be useful here.

    Distrubuted Software
  • IceCC - aka ice cream, a distributed GCC
  • Haddop - For both hfs experiment and of course map/reduce.
  • OpenMPI - Not sure how well this will work, but worth given it a shot.
  • Tensor Flow - For machine learning in parrallel
  • Gluster - Clustered disk space. Does not have to be Gluster, just an example.
  • HTCondour - Or some other type of bath based interface.
  • HiveQT - For distributed data collection, although more likely this will be a bunch of mosquitto's
  • Other - Can try things like kafka, cassandra, etc, and build those onto the cluster.

Overall not sure how many of these will handle a system that will be continously growing and could have some nodes that disappear altogher so likely need something to manage it all. Of course docker/k8y comes to mind, we will have to see how well that'll work on the pi zero w's which look like they are going to be a majority of the House of Cloud PI, as they fit just about anywhere.

Other Software

Going to need a gateway with some level of monitoring software on it along with a something like Home Assistant to cover the HA part, will need to run BATMAN-ctrl to view the mesh. Some of the tools will need be bumped up to a web front end. I also feel like the gateway should have a monitor on it, but not a requiement at this point.

Starting to look like this useless thought is starting to form into a not-so-useless thought.

Labels:

Comments

Post a Comment

Popular posts from this blog

Thought 70: Determinism.

Hold on your butts, this one is a wild ride, and specifically from my point of view. It's more a journey from when I was about 6, until today, and a little bit beyond that, about a week under normal conditions, but that last part flucuates quite a bit. I cannot explain all of it, but I can describe my experiences, and you don't have to believe them, they are merely my observations. I feel I have to start with sleep and dreaming, since so much of the experience is rooted inside dreams and more specfically dejavu. We have to suspend the dejavu for a moment to get through this, but trust me, we'll get back there, it's too important to leave out. I am a lucid dreamer, in full color, full audio, lots of detail, but not sharp details. Note that last one, it's important as well. I have been my whole life or as far back as I can remember, dreamed vividly of all my childhood nightmares and having the ability to conjure heroes to fight them. This battle somewhere in the...
Post a Comment
Read more

Thought 16 - Kid Power

In response "Thought 14 - Perpetual Cat" sugarbumkin said, "The same theory could be applied to balloons tied to kindergarteners at recess. I like it." Well this got me thinking... Clothes with that are laced with MEMS generators. A MEMS generator is a solid state electronic circuit that generates low level of current though passive motion of the environment. Things like temperature change, acceleration, and even Brownian motion are converted to power using a MEMS generator. So, now we have attached them to small free moving bipeds of pure energy. How do we get the energy back. I figure that we isolate the playground into a large battery configuration where the children are running around on a conductive plate that makes contact with the heels of their shoes. They will run around with a super capacitor in addition to the MEMS, when their feet touch the ground the super-cap is discharged into the conductive plate underneath them. I do not think that the childr...
2 comments
Read more

Thought 5 - The Ferengi of New Jersey

Just got back from a wedding in Jersey, and have determined that New Jersey has a lot going for it, and a lot of peculiarities to it as well. First the good: Mandatory recycling. Recycling is curb side and everything goes, this is a great benefit, as there are no third parties involved or hippies to worry about, everyone just recycles. Recycling also requires little effort on the user, plastic, glass, and metals all go in the same container, then paper products in another. Now the strange: Everyone drives everywhere, but there are lots of trees. Like a giant suburbia, where the trees have not yet been killed off by the logging industry. Now, having ridden my bike for most of my life, and having walked the dogs in the morning, I have become more aware of my sense of smell. And oddly New Jersey smells like conflict, the conflict between the cars trying to pollute the world and the trees absorbing that pollution and releasing oxygen. Quite and odd balance when the brain is in a toss...
Post a Comment
Read more