[ad_1]
A Raspberry Pi is All You Want
Typically, we have to accumulate some information inside a sure time period. It may be information from the IoT sensor, statistical information from social networks, or one thing else. For example, the YouTube Data API permits us to get the variety of views and subscribers for any channel on the present second, however the analytics and historic information can be found solely to the channel proprietor. Thus, if we need to get weekly or month-to-month summaries about these channels, we have to accumulate this information ourselves. Within the case of the IoT sensor, there could also be no API in any respect, and we additionally want to gather and save information on our personal. On this article, I’ll present the best way to configure Apache Airflow on a Raspberry Pi, which permits operating duties for a protracted time period with out involving any cloud supplier.
Clearly, in case you’re working for a big firm, you’ll most likely not want a Raspberry Pi. In that case, in case you want an additional cloud occasion, simply create a Jira ticket to your MLOps division 😉 However for a pet venture or a low-budget startup, it may be an attention-grabbing resolution.
Let’s see the way it works.
Raspberry Pi
What is definitely a Raspberry Pi? For these readers who’ve by no means been enthusiastic about {hardware} for the final 10 years (the primary Raspberry Pi mannequin was launched in 2012), I can briefly clarify that this can be a single-board laptop operating full-fledged Linux. Often, a Raspberry Pi has a 1GHz, 2–4-core ARM CPU and 1–8 MB of RAM. It’s small, low cost, and silent; it has no followers and no disk drive (the OS is operating from a Micro SD card). A Raspberry Pi wants solely an ordinary USB energy provide; it may be linked by way of Wi-Fi or Ethernet to a community and run completely different duties inside months and even years.
For my information science pet venture, I needed to gather the YouTube channel statistics inside 2 weeks. For a process that requires solely 30–60 seconds twice per day, a serverless structure could be a good resolution, and we will use one thing like Google Cloud Function for that. However each tutorial from Google began with the phrase “allow billing to your venture”. There’s free first credit score and free quotas offered by Google, however I didn’t need to have one other headache of monitoring how a lot cash I…
[ad_2]
Source link
