• About Me Card

Max Hemingway

~ Musings as I work through life, career and everything.

Max Hemingway

Author Archives: Max Hemingway

Open Source Web Crawlers and Data Sets

15 Friday May 2015

Posted by Max Hemingway in Big Data, Data Science

≈ 1 Comment

Tags

Big Data, Data, Data Science

webA great list of 50 Open Source Web Crawlers has been produced by Baiju NT on a Big Data Blog

Web Crawlers are useful in gathering data from other sites when performing research, although caution should be used as with today’s levels of protection some sites defenses may consider your data gathering as an attack.

Its probably best to check first if any data sets exist with the data you are looking for.

https://www.quandl.com/ is a search engine for data sets that has listed 12 million data sets.

There are lots of data sets available from governments such as http://data.gov.uk/ in the UK.

If its a smaller list of good data sources is needed have a look at http://www.kdnuggets.com/datasets/index.html

Sources:

  • https://www.quandl.com/
  • http://www.kdnuggets.com/datasets/index.html
  • http://bigdata-madesimple.com/top-50-open-source-web-crawlers-for-data-mining/

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Raspberry PI Development Projects – Are these the next big thing?

07 Thursday May 2015

Posted by Max Hemingway in Development, IoT, Programming, Raspberry Pi

≈ Leave a comment

Tags

Coding, Development, Innovation, IoT, Programming, RaspberryPI

PIElement 14 has been running a competition recently called “Sci Fi Your PI” which looked to make science out of science fiction using Raspberry PI’s.

25 challengers have now been selected to continue forward. The ideas that have been selected are both creative and interesting.

Below is the list of the 25 chosen with their synopsis.

Brenda Armour from Canada –  Project: Rover Pi Protector

Synopsis: I am proposing a mobile motion detection device that can capture photos and videos of wildlife and be tracked using GPS and a small inertial navigation system. The Rover Pi Protector will use motion sensors (accelerometer and magnetometer) to calculate position, orientation and velocity. Audio processing will send a warning of noise that is not found in their environment. This may include helicopters and chain saws. These are instruments used by poachers to kill elephants and rhinos for their ivory.

Inspiration: My inspiration for this project is the first Alien movie where they detect a life form on a remote planet.

Neil Bizzell from United Kingdom – Project: Steampunk Navigation Aid

Synopsis: My plan to ‘Sci-Fi My Pi’ is to create a device inspired by the works of Jules Verne, HG Wells and the Steampunk sub genre or Sci Fi. The device is a navigational aid developed to make charting the progress of adventurers such as Prince Dakkar’s alter ego Captain Nemo around their world. The device will allow the discerning adventurer to see how to get to the destination required for his quest. It holds a list of preset destinations and start points which can be selected using a wheel. Once the destination is selected the directional indicator will show in which way the traveler should proceed. The chart position indicator shows the current position on the world map.

Joe Carender from United States – Project: Intelligent Body Armor

Synopsis: Intelligent body Armor with sensors for body temp, heart rate, hit sensors and wireless helmet mounted display that has readout for GPS location, body temperature, heart rate, humidity, wind speed and direction and Armor damage percentage and wireless weapon mounted camera and tracking system using voice commands with wireless wrist mounted keyboard control and all components would be networked together for use in airsoft war games and maybe for real life combat implementation, like the armor suit in the video game Crysis.

Vivien Chin from Singapore – Project: Advanced Dog Trainer

Synopsis: Our device consists of a food dispenser and a sound detector that picks up any sound that might trigger the dog to bark. It pre-empts the activity of barking and replaces it with the activity of eating the food. This method works well when the person training the dog is consistent and prompt with the food delivery.
A motion sensor can be placed at the entrance of a passage way and the dispenser will dispense a treat every time a person walks through. This device rewards the dog whenever it sees a stranger. The system consists of a food dispenser and a set of sensor devices. For example, the sensor in this application would be an motion detector that will detect whether a person or animal has crossed the threshold. When that happens, the dispenser will dispense food to the dog.

Inspiration: The inspiration comes from the hi-tech home of The Jetsons. For example, Astro, the dog has a treadmill to solve his problem of getting enough exercise. IOT is the future of homes and care for our pets will also follow that direction.

Trevor Clarke from United Kingdom – Project: I Ching Hexagrams

Synopsis: The design will cast I Ching Hexagrams and provide a visual depiction of the Hexagram it has cast via the PiFace Control & Display, plus deliver an audio description of the Hexagram and an interpretation of its meaning using the Wolfson Audio card.
A possible enhancement if time allows is voice activated casting of the Hexagram. Another possible enhancement is the ability to keep the hexagram history if storage capacity allows.

Inspiration: This idea is inspired by the computer on Hagbard Celine’s submarine from the Illuminatus Trilogy by Robert Shea and Robert Anton Wilson.

Eric Ellwanger from  United States – Project: Escape From the Past

Synopsis: I feel like the Raspberry Pi with its multiple serial ports (GPIO RS232 and USB ports) would be an excellent platform to be a “serial master” that can open up the number of communication channels for a PLC. In addition, the Ethernet port can act as a high speed communication method to send data to a centralized database for analysis not only for OEE and TPM programs, but for other engineering needs as well.
Inspiration: This project reminds me of the old 80’s film ‘Back to the Future’, where I (much like Marty McFly) find myself trapped in the past. This past is where the technology lacks the communication capabilities of modern day devices.

Ambrogio Galbusera from Italy – Project: Training Hover Sphere

Synopsis: In “Star Wars”, a young Luke Skywalker is trained to use the force and sense your enemy. In the training sessions, the enemy is an hovering sphere that randomly fires laser shots. The apprentice Jedi has to intercept the non-lethal laser beams with his light saber. For this challenge, I’d like to build a similar gadget.

Sebastian Groza from Romania – Project: Cybernetic Computer Interface

Synopsis: Star Wars was THE Sci Fi movie of my childhood and still one of my favorites. The Star Wars universe represents a great source of inspiration from starships to robots, weapons, armors, clothes and various gadgets.

Inspiration: The source of inspiration for my project is “Borg Construct Aj^6” device, used by Lobot in Cloud City, Star Wars – Episode 5 – Empire Strikes Back. I believe this device is a good model of a Sci Fi device which can be turned into a real world tool.
Read Sebastian’s project blogs (tag cybernetic_interface)

Michael Hahn from United States – Project: Handheld Sensor Device

Synopsis: As an electronic technician, TV repairman, hobbyist, and ISP provider the thought of bringing another Star Trek concept to application is very intriguing. Specifically, a scientific and/or medical tricorder as seen in the ST: TOS. A device similar to one that the actors DeForest Kelly and Leonard Nimoy used on the show to evaluate the environment, atmospheric conditions, temperature, humidity, etc.
As part of this challenge I will attempt to incorporate various sensors into a compact handheld device with the RPi.

Augusto Lisbôa from Brazil – Project: Diplomatic Robot Head

Synopsis: My project consists from a C3PO-like head unit (from STAR WARS) that recognizes speech and text language (using Google or MS Bing translator API’s.), that can become even a “diplomatic” robot, using search API’s (Google or Bing), to search the requested laws that can be spoken, or captured by RPi cam.

Mark Loomis from United States – Project: Glove Computer & Control

Synopsis: On my left arm, I would like a Nintendo glove / gauntlet type computer and control system for control of the vehicle, cameras, sensors, interface to a quadcopter for extended range, etc. I will use a combination of crafted leather and 3D printed parts to make the electronics fasten to the gauntlet.

Inspiration: The source of my inspiration is Star Wars; the tricorder from Star Trek is also an inspiration.
Eric Lovejoy from United States – Project: The Empathy Box

Synopsis: In Philip K. Dick’s book, “Do Androids Dream of Electric Sheep”, Wilbur Mercer describes the Empathy Box as: “(it) is a networked appliance that connects many anonymous people through shared warmth.” “An empathy box,” he said, stammering in his excitement, “is the most personal possession you have. It’s an extension of your body; it’s the way you touch other humans, it’s the way you stop being alone.” My version of the Empathy Box will not be a phone, although ideally it would be portable like one. Controls (potentiometers or rotary (encoders so I don’t need to use an ADC) (3)) will control the level of “Pain” (annoying audio feedback).

Enrico Miglino from Balearic Islands, Spain – Project: Meditech

Synopsis: This project covers a Polyfunctional Multimeter equipped with built-in features for continuous and spot measurement applications by means of specific probes connected to the equipment.

Inspiration: the Meditech application is inspired by the medical tool used by Star Trek crew when they are on an hostile planet.

Wilson Oberholzer from United States – Project: KITT Car

Synopsis: I plan to turn my car into an emulation of the KITT 2000 from the original “Knight Rider” TV-series starring David Hasselhoff. The main parts of the project will be the “light scanner” on the front of the car, the display screen/”AI”, and the various control panels in the car. The function of the panels will be mostly cosmetic (“Turbo Boost” won’t actually make the car faster but may prompt responses from the system). I will need to construct a console to hold everything in place on the car as well as mounts for the special effect items. I’ll start by listing the features I plan to make a reality, draw some rough layouts of things, get basic systems working outside of the car, then design and fabricate the system, and finally debug it all.

Margot Paez from United States – Project: Pizza Pi

Synopsis:Currently a pizza box is nothing more than a cardboard container. It keeps the pizza from losing heat too quickly and from losing its shape during transportation. Some might say this is more than enough, but if the Internet of Things is truly meant to bring the future to us, then even pizza boxes need to be revamped.
Inspiration: This pizza box is inspired by the one featured in Neal Stephenson’s sci-fi novel, Snow Crash.

Cecil Perks from United States – Project: Visus Sancto

Synopsis: Visus Sancto which is Latin for “Ghost Sight”, is a project I have been thinking about doing for some time. It is based on the theory that IR cameras can detect the presence of ghosts or other paranormal entities. The setup uses a Raspberry Pi as the main unit to control an IR camera mounted on a headset with a small screen to give a real-time heads-up display. The IR camera will be mounted in front of the human eye with a pan and tilt mount.

Inspiration: My inspiration is “The Schufftein Glasses” from “Hellboy 2: The Golden Army”.

Arsenijs Picugins from Latvia – Project: PipBoy Personal Helper

Synopsis: There are a lot of different smartphones now, but none have all the things that I need. The personal helper I’d like to have resembles the PipBoy. A wrist-wearable computer that has all kinds of features incorporated into it. In Fallout, it’s a resource, health, travel and task management device. That’s what a Lone Wanderer needs. We, being trapped in urbanized environments, need that and even more than that. We also need communication and entertainment. That’s where my idea steps in.

K.C. Rajesh from Canada – Project: PiBo

Synopsis: The inspiration for my design is “Weebo” from the 1997 movie “Flubber” produced by Disney. Weebo is a robot that is able to float around and help the scientist Philip the main protagonist in the movie. Flubber is able to communicate with people using voice and video. In 1997 this was a treat to watch as part of the movie. Weebo was able to portray human emotion using lights and a video screen. Although this was way before the time, we continue to see toys like Zoomer, able to move and respond to human commands. It will be useful to have a helper that can move and provide information using multi media. In todays connected world, if the robot can connect to applications and websites over the network.
Inspired by Weebo, I plan to build PiBo who may have comparable functions to the original but will move using wheels and be a terrestrial robot rather than an air-borne one.

Kenny Rasschaert from Belgium – Project: Real-Life Holographic Projector

Synopsis:Holograms have appeared in many works of science fiction, most notably in the Star Wars trilogies. Through these projections, pre-recorded messages could be displayed in the air and Jedi Masters are able to attend council meetings even when they are away from Coruscant. Tupac Shakur’s appearance on Coachella in 2012 was a sudden reminder to the world that we have had this technology for a while. Through a technique called Pepper’s Ghost, an image can be projected onto a transparent surface and appear as if it’s really there. In essence, a hologram. For this design challenge, I would leverage Pepper’s Ghost to give an R2D2 model a real-life holographic projector to be used for telepresence video conferencing.
Shrenik Shikhare from India – Project: Sci Fi Advanced Controls

Synopsis: My first idea is the one where Tony Stark interacts with his computers with hand gestures. Picks up file from One computer monitor and Puts in other Computer and starts interacting with. In my project I would love to do similar thing with Images/ Pictures first. If possible same thing I would love to do with Videos and supported file. I feel it’s a very cool project.

My second idea is a Surface Table: we can find this in many movies from Mission Impossible to Amazing Spiderman to Iron Man once again. Those are mostly touch based, but I am looking to use the Microchip’s MGC 3130 GestIC kit that I have from element14 to interact with displays. Here As I don’t have such big monitor, I would use my laptop display as surface display.

My third idea is a Wrist Computer: if time permits I would love to implement a wrist computer, just like personal assistance we would have seen in movies. A Raspberry Pi + PiFace (though it’s bulkier) would do this job. Also if possible a GPS integration with this computer enable a Door unlock mechanism based on my location. And Door lock unlock can be handled by Gertboard.

Harsahib Singh from India – Project: Verbal & Physical Morality Monitor

Synopsis: This project is inspired by the movie Demolition Man and the future society it envisions. The movie is set in the 2030’s when crime has been completely eradicated inside a tightly controlled society. Swearing is a violation of the ‘verbal morality statues’ and its enforcement is done through monitoring devices mounted in each room. These verbal morality statute monitors are a running joke in the movie as characters use profanity and trigger violations. This project is an attempt to recreate the verbal morality statute monitor from Demolition Man as well as a practice to enhance the same concept for physical morality which is very common in workplaces and houses.
The project will work on the speech recognition program which is to be loaded for the first time, the device will continuously take the voice signals as input through the microphone module and will be checking the words against the programmed code for any verbal morality and in case it finds out any abusive speech the camera module will be switched on to record the current situation.

Inderpreet Singh from India – Project: VIRUS (Voice & Gesture Instructed Robots & Control of Universal Systems)

Synopsis: My proposal is conceptualized atop the fusion of JARVIS from Iron Man which is a voice Home Automation System and the Minority Reports gesture Control System, merged with robots such as R2D2, C3PO (StarWars), Rosie (Jetsons), Wall-E and possibly leverage the power of IoT by offloading Computational components to the cloud like SkyNet (Terminator). The idea is to create a reconfigurable robot that can be “Transformed” and can link up to a central computer.

Joey Thompson from United States – Project: QuadCop

Synopsis: The QuadCOP will be a low cost and custom built quadcopter.
Inspiration: In many sci-fi movies there are flying vehicles that perform some sort of security or searching. These vehicles are typically autonomous and feature dramatic reactions when something is detected. Lights, voices, or even gun fire are common.
My favorite examples are from the Terminator Franchise which are called “Hunter Killers”. Hunter Killers (HK) are used in the movie to search for humans. In the movie they roam around slowly and methodically using huge search lights that sweep the ground below.
A couple of other great examples are the areal drones in the latest Robocop and in the video game Call of Duty: Modern Warfare. In that game several quadcopter drones are used to perform security and fly set paths scanning for intruders. The quads are constantly interlinked so damaging one quad will alert all the others. The quads are also used remotely to search areas via a live stream and the quad has a certain level autonomous movement assisting the user.

Frederick Vandenbosch from Belgium – Project: Touch / Motion Controls

Synopsis: When thinking about science-fiction, things that come to mind are touch / motion controls, things that slide in and out of place and bright lights. This is why I would like to propose to build the desk of the future, inspired by some visual effects of the Tron Legacy movie.

Jeremy Walker from United States – Project: Robotic Assistant for Everyday Delegations

Synopsis: Smart-phones enable us to communicate in more fantastic ways than some sci-fi predictions, and offer incredible computing power. The rise of 3D printing is the precursor to more fantastic replication machines – yet we still don’t have a general purpose household robot. Roombas are a great start, but where is our version of the Jetsons’ Rosie? Our C3-P0? Our CL4P-TP? The duties commonly attributed to this role are within our reach, and with your help, I intend to achieve them through RAED (Robotic Assistant for Everyday Delegation).

The ideas that have not been chosen also have some excellent innovative ideas. There are projects here that may end up being the next big thing if they are successful with their solutions.

I will certainly be following these with interest.

The source for this blog post, links to the individual blogs and full list is available at: http://www.element14.com/community/docs/DOC-76303/l/sci-fi-your-pi-challengers

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Microsoft Ignite Conference

05 Tuesday May 2015

Posted by Max Hemingway in Architecture, Tools

≈ Leave a comment

Tags

Architecture

Hot on the Heels of the Microsoft Build Conference, the Microsoft Ignite Conference is under way.

Once again the conference is being streamed with sessions online for those who cant get to the conference.

You can follow the conference at http://ignite.microsoft.com/

Replays available here http://ignite.microsoft.com/Sessions

learn

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Microsoft Build Conference

30 Thursday Apr 2015

Posted by Max Hemingway in Development, Programming, Tools

≈ 1 Comment

Tags

Coding, Development, Programming

The Microsoft Build conference is in fully swing with Day 2 coming up. Although I am not there in person, its good to see that the sessions are being streamed and recorded.

You can follow the conference at http://www.buildwindows.com/

Replays available here

There is already a lot of news stories coming out on the latest Microsoft developments from the conference. Some of the highlights are:

  • Microsoft looking for 1 billion devices running Windows 10 within first year of release
  • Reuse of Java and C++ code that comes from android
  • Microsoft Edge browser for Windows 10
  • Hololens highlighted with education – 3D images

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Data Mining Courses

28 Tuesday Apr 2015

Posted by Max Hemingway in Big Data, Data Science

≈ 1 Comment

Tags

Big Data, Data, Data Science, learning

mineVia Coursera the University of Illinois at Urbana-Champaign is running a specialisation on Data Mining.  As with all Coursera courses, you don’t have to take the specialisation, but can take the courses individually or one after each other. Taking the courses outside of the specialisation means that you wont get to complete the capstone project and earn your certificate at the end.

This track is made up 5 courses covering:

Pattern Discovery in Data Mining

  • Introduction to data mining
  • Concepts and challenges in pattern discovery and analysis
  • Scalable pattern discovery algorithms
  • Pattern evaluation
  • Mining flexible patterns in multi-dimensional space
  • Mining sequential patterns
  • Mining graph patterns
  • Pattern-based classification
  • Application examples of pattern discovery

Text Retrieval and Search Engines

  • Introduction to text data mining
  • Basic concepts in text retrieval
  • Information retrieval models
  • Implementation of a search engine
  • Evaluation of search engines
  • Advanced search engine technologies

Cluster Analysis in Data Mining

  • Basic concept and introduction
  • Partitioning methods
  • Hierarchical methods
  • Density-based methods
  • Probabilistic models and EM algorithm
  • Spectral clustering
  • Clustering high dimensional data
  • Clustering streaming data
  • Clustering graph data and network data
  • Constraint-based clustering and semi-supervised clustering
  • Application examples of cluster analysis

Text Mining and Analytics

  • Overview of text analytics and applications
  • Extending a search engine to support text analytics (text categorization, text clustering, text summarization)
  • Topic mining and analysis with statistical topic models
  • Opinion mining and summarization
  • Integrative analysis of text and structured data

Data Visualization

  • Visualization Infrastructure (graphics programming and human perception)
  • Basic Visualization (charts, graphs, animation, interactivity)
  • Visualizing Relationships (hierarchies, networks)
  • Visualizing Information (text, databases)

These courses would complement the courses from John Hopkins on Data Science

Source: https://www.coursera.org/specialization/datamining/20

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Big Data – 4V’s + Verification

27 Monday Apr 2015

Posted by Max Hemingway in Big Data, Data Science, IoT

≈ Leave a comment

Tags

Big Data, Data, Data Science, Infographic, IoT

IBM have released an Infographic on the “Four V’s of Big Data” which covers:

  • Volume – Scale of Data
  • Variety – Different forms of Data
  • Velocity – Analysis of Streaming Data
  • Veracity – Uncertainty of Data

4-Vs-of-big-data

There should be another V for “Verification” which covers the questions you ask of the data in order to obtain the results. A check should also be made on the data to look at the inference of the results as different views or questions asked in a slightly different way could produce completely different outcomes in the data.

Having the right data is important and ensuring the data gathered and collected is relevant to the business questions you are asking. Two stats in the infographic stick out for me on this:

  • $3.1 Trillion a year on poor data quality
  • 40 Zetabytes of data created by 2020

Perhaps with the right Verification there may not be so much uncertainty (Veracity) and a huge saving to businesses reducing a high loss in money, time and incorrect data.

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Faster Smaller Raspberry Pi Cluster

18 Saturday Apr 2015

Posted by Max Hemingway in Innovation, IoT, Programming, Raspberry Pi

≈ Leave a comment

Tags

Innovation, IoT, Programming, RaspberryPI

Following on from my blog “Race to the largest Raspberry Pi Cluster“, James J. Guthrie has built a 3 node cluster out of Raspberry Pi 2’s using 3 nodes, out performing the 64 node cluster.

The Iridis Pi has a peak CPU performance benchmark was around 1 GIGAFLOPS (floating point operations per second)

The cluster presented here is made of 3 second generation Pi’s (nodes) and has a peak performance of over 3 GIGAFLOPS.

A short paper on the cluster can be found at the link below.

http://personal.strath.ac.uk/james.guthrie/jabopi/

PI

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

R {swirls} – Learning R by doing

16 Thursday Apr 2015

Posted by Max Hemingway in Data Science, Programming

≈ 1 Comment

Tags

Coding, Data Science, Programming, R

A swirl is an interactive way of learning R by installing a package called {swirl} into R and then installing a course.

I have used swirls in the Data Science Courses on Coursera and found them a useful way of learning and testing your knowledge.

swirl is installed as a package into R using the following command in R (internet connection required).

> install.packages("swirl")

Then launching the swirl library and run it.

> library("swirl")
> swirl()

To locate a swirl course use the following command.

?InstallCourses

Sources: Swirlstats

There are a list of courses available in the swirl repository on GitHub. There are 3 levels of courses available.

Beginner

  • R Programming: The basics of programming in R
  • R Programming Alt: Same as the original, but modified slightly for in-class use
  • Data Analysis: Basic ideas in statistics and data visualization
  • Mathematical Biostatistics Boot Camp: One- and two-sample t-tests, power, and sample size
  • Open Intro: A very basic introduction to statistics, data analysis, and data visualisation

Intermediate

  • Regression Models: The basics of regression modeling in R
  • Getting and Cleaning Data: dplyr, tidyr, lubridate, oh my!

Advanced

  • Statistical Inference: This intermediate to advanced level course closely follows the Statistical Inference course of the Johns Hopkins Data Science Specialization on Coursera.

To install a course you can use the following commands in R

library(swirl)
install_from_swirl("Course Name Here")
swirl()

Datacamp have recently released a free browser based R learning tool. This is a browser based  version to learn R based on a flipcard version of swirl teaching you in bite sized chunks.

Sources:

  • Swirlstats
  • GitHub swirl
  • Datacamp

R

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

IoT Operating Systems

14 Tuesday Apr 2015

Posted by Max Hemingway in Architecture, IoT, Programming, Security

≈ 1 Comment

Tags

Architecture, Development, Innovation, IoT

A recent paper from the Cornell University has been published that covers a “Survey of Operating Systems for the IoT Environment“. (IoT = Internet of Things). Things

It looks at the Operating Systems produced for the chipsets used in IoT sensors, RFID and devices.

The paper lists the following Operating Systems and provides an overview of their capabilities and aligned chipsets.

  • mbed (ARM)
  • RIOT OS
  • Contiki
  • TinyOS
  • Nano-RK
  • FreeRTOS

The paper is worth a read if you want a good overview of IoT Operating Systems and their capabilities.

Source: http://arxiv.org/ftp/arxiv/papers/1504/1504.02517.pdf

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...

Email Overload

13 Monday Apr 2015

Posted by Max Hemingway in Productivity, Social Media, Tools

≈ Leave a comment

Tags

Communication, Email

stampsHaving just had a few days off I have come back to the usual full mailbox and a quota that’s blown so need to clear items out before I can send anything.

This is a very common place occurrence for people now, but how do we actually behave with and use email?

A recent study “Evolution of Conversations in the Age of Email Overload” carried out by Yahoo and Cornell University studied more than 2 million users exchanging 16 billion emails over several months.

The study itself shows some interesting results, but is based between pairs of people who send more than 5 replies to each other and have opted in to surveys which provides a level of bias into the survey.

Youngest email users, teens, have the fastest reply times; as users get older they become slower to reply to emails.

Email

The survey provides details on the response times (medians of results)

  • 13 minutes for Teens
  • 16 minutes for Young Adults (20–35 years old)
  • 24 minutes for Adults (36–50 years old)
  • 47 minutes for Mature users (51 and older)

These figures for me show how the Younger Generations are more reliant on technology and interact with social media at a more frequent rate than their peers. It would be interesting to see the results on a wider distribution of users and email interactions though and if that has a skew on the results, also what device the users have access to which may dictate the speed of the reply.

Source : http://arxiv.org/abs/1504.00704

Share this:

  • Share on Facebook (Opens in new window) Facebook
  • Share on LinkedIn (Opens in new window) LinkedIn
  • Email a link to a friend (Opens in new window) Email
  • Share on Pinterest (Opens in new window) Pinterest
  • Share on Reddit (Opens in new window) Reddit
  • Share on X (Opens in new window) X
  • Share on Tumblr (Opens in new window) Tumblr
  • Share on Pocket (Opens in new window) Pocket
  • Share on Telegram (Opens in new window) Telegram
  • Share on Threads (Opens in new window) Threads
  • Share on WhatsApp (Opens in new window) WhatsApp
  • Share on Mastodon (Opens in new window) Mastodon
  • Share on Bluesky (Opens in new window) Bluesky
  • Share on Nextdoor (Opens in new window) Nextdoor
Like Loading...
← Older posts
Newer posts →

Follow Me on LinkedIn

www.linkedin.com – Click to Follow 

RSS Feed

RSS Feed RSS - Posts

Other Publications I contribute to

https://sparrowhawkbushcraft.com/

Recent Posts

  • Preparing for Post Quantum Security: Key EA Strategies
  • Graceful Speech & Timeless Tales: The Complete Series Index
  • Graceful Speech & Timeless Tales: Unlocking the Power of Tone
  • Why Boards Overlook Enterprise Architecture
  • Graceful Speech & Timeless Tales: The Elements of Elocution

Categories

  • 21st Century Human
  • 3D Printing
  • AI
  • Applications
  • ArchiMate
  • Architecture
  • Arduino
  • Automation
  • BCS
  • Big Data
  • Certification
  • Climate Change
  • Cloud
  • Cobotics
  • Connected Home
  • Data
  • Data Fellowship
  • Data Science
  • Development
  • DevOps/OpsDev
  • Digital
  • DigitalFit
  • Drone
  • Enterprise Architecture
  • F-TAG
  • Governance
  • Health
  • Innovation
  • IoT
  • Machine Learning
  • Metaverse
  • Micro:Bit
  • Mindset
  • Mobiles
  • Networks
  • Open Source
  • Podcasts
  • Productivity
  • Programming
  • Quantum
  • Raspberry Pi
  • Robotics
  • Scouting
  • Scouts
  • Security
  • Smart Home
  • Social Media
  • Space
  • STEM
  • Story Telling
  • Technologists Toolkit
  • Tools
  • Uncategorized
  • Wearable Tech
  • Windows
  • xR

Archives

Reading Shelf

Archives

Recent Posts

  • Preparing for Post Quantum Security: Key EA Strategies
  • Graceful Speech & Timeless Tales: The Complete Series Index
  • Graceful Speech & Timeless Tales: Unlocking the Power of Tone
  • Why Boards Overlook Enterprise Architecture
  • Graceful Speech & Timeless Tales: The Elements of Elocution

Top Posts & Pages

  • Preparing for Post Quantum Security: Key EA Strategies
  • Mastering the CPD Cycle for Professional Growth
  • Race to the largest Raspberry Pi Cluster
  • No Batteries Required: My Personal Journal
  • 20 Informative Podcasts for 2025: Boost Your PKMS
  • Digital Scouting
  • Embracing Excellence: The Value of Chartered IT Professionals (CITP)
  • Building a Quadruped
  • Everyone needs good Cyber Security knowledge
  • Why Boards Overlook Enterprise Architecture

Category Cloud

21st Century Human Architecture Automation Big Data Cloud Data Data Science Development DevOps/OpsDev Digital DigitalFit Enterprise Architecture Innovation IoT Machine Learning Mindset Open Source Podcasts Productivity Programming Raspberry Pi Robotics Security Social Media STEM Story Telling Technologists Toolkit Tools Uncategorized Wearable Tech

Tags

3D Printing 21st Century Human AI Applications Architecture artificial-intelligence Automation BCS Big Data Blockchain business Certification Cloud Cobot Cobotics Coding Communication Connected Home CPD creativity cybersecurity Data Data Fellowship Data Science Delivery Development DevOps Digital DigitalFit Digital Human Drone Email Enterprise Architecture GTD Infographic Information Theory Innovation IoT Journal Knowledge learning Machine Learning Metaverse MicroLearning Mindset Mixed Reality Networks Open Source OpsDev PKMS Podcasts Productivity Programming Proving It Quantum quantum-computing R RaspberryPI Robot Robotics Scouts Security Smart Home Social Media STEM Story Telling Technologists Toolkit technology Technology Couch Podcast Thinking Tools Visualisation Voice Wearable Tech xR

License

Creative Commons Licence
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Meta

  • Create account
  • Log in
  • Entries feed
  • Comments feed
  • WordPress.com

Blog at WordPress.com.

  • Subscribe Subscribed
    • Max Hemingway
    • Join 82 other subscribers
    • Already have a WordPress.com account? Log in now.
    • Max Hemingway
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...
 

    %d