Value this

Welcome to my data science blog.

Setting up AWS Cloud for InfluxDB

AWS

EC2

InfluxDB

How to set up AWS Cloud for InfluxDB?

Grouping data with Flux in InfluxDB

InfluxDB

Flux

time-series

How can you group data with Flux in InfluxDB?

Filtering with Flux in InfluxDB

InfluxDB

Flux

filtering

querying

How does filtering works with Flux in InfluxDB?

Writing data to InfluxDB with Telegraf

InfluxDB

time-series

database

How to use Telegraf to write data to InfluxDB?

Notifications in InfluxDB

InfluxDB

monitoring

time-series

notification

How to create and manage notifications in InfluxDB?

Checks in InlfuxDB

fastai

You can use InfluxDB to monitor your data and generate notifications reporting its status.

InfluxDB tasks

fastai

Tasks are scheduled Flux queries that allow you to process data with InfluxDB. ### Task components Tasks should have the following components:

Custom dashboard variables in InfluxDB

fastai

You can create a new variable in the Data Explorer, in the Settings or import from InfluxDB in JSON. Here we review the steps to create a variable in the Data Explorer

Dashboard variables in InfluxDB

fastai

Dashboard variables are useful when you would like to modify dashboard cells without editing the original queries based on which the dashboard is built. You can also use…

Data visualization and dashboards with InfluxDB

fastai

You can choose a different graph type from the left menu.

InfluxDB Design principles, Line Protocol, Data Schema

fastai

The elements of the line protocol

InfluxDB organizing concepts (Organization, Buckets, Data elements)

fastai

Organizations behave as workspaces. They can possess

Querying InfluxDB with Flux

fastai

Flux is a functional data scripting language designed specifically for time series data exploration and data processing with InfluxDB.

Scraping, writing, and querying data with InfluxDB

fastai

InfluxDB can scrape data - Can collect data in specified intervals - Saves data into a InfluxDB bucket - It collects data from endpoints that accept HTTP(S) and that provide…

InfluxDB ebook outline

influxDB

gumroad

ebook

content strategy

The outline of the introductory InfluxDB ebook I plan to write.

Starting off with InfluxDB

fastai

InfluxDB is perhaps the most popular Time Series databases out there.

Time series databases

fastai

Time series databases (TSDB) are specifically designed to store time series data, most importantly by storing time/value pairs. The use of time as a key index is perhaps the…

Principal Component Analysis from scatch - preparations

fastai

From the Data Science from Scratch book.

Named tuples and dataclasses

fastai

A quick review of named tuples (standad and typed) and dataclasses.

Stochastic gradient descent

fastai

From the Data Science from Scratch book.

Gradient Descent Minibatch

fastai

From the Data Science from Scratch book.

Gradient descent from scratch with Python

fastai

From the Data Science from Scratch book.

Difference quotients from scratch with Python

fastai

From the Data Science from Scratch book.

Using the Beta distribution

fastai

We try to use beta distributions to estimate if our coin is fair.

Beta distribution

fastai

When trying to to Bayesian interference to estimate probability, we can use Beta distribution as a prior. Below are some steps to calculate it.

A/B testing with Python

fastai

Introduction to A/B testing with python.

Programmatic p-hacking from scratch with Python

fastai

Below is a short script to demonstrate the ‘process of p-hacking’.

Confidence intervals from scratch with Python

fastai

From the Data Science from Scratch book.

p-values with Python from scratch

fastai

Calculating p-values with python.

Hypothesis test power from scratch with Python

fastai

Calculating power of hypothesis tests.

Normal approximation of binomial distribution

fastai

The change of standard deviation with the incrase of number of trials.

Probability interval boundaries with Python

fastai

In the previous post we calculated proabilities and z values with Python. Here we continue with finding the interval boundaries belonging to a particular tail or two-sided…

Inverse normal cumulative distribution - finding \(z\) values from probabilities with Python

fastai

Sometimes we would like to find the \(z\) values belonging to a particular probability. For this we use an inverse cumulative distribution function.

Loading MEG data with the `MNE` python package

fastai

I am interested in sleep data analysis, where one core informational source is neurophysiological data and in particular EEG data coming from polysomnigraphy.

Probability test

fastai

Calculating probabilities of values in relation to threshold values.

Docker cheatsheet

fastai

Main ideas and docker file commands (based on this blog post).

A first view on Streamlit

fastai

I had a look into streamlit as anoter way to deploy a data science app. It seems really convenient to work with.

Command line tips for quick navigation in the terminal

terminal

navigation

tips

Quick tips for quick navigation in the terminal

Central Limit Theorem on the binomial distribution from scratch with Python

fastai

Here I am playing with the Central Limit Theorem.

Probabilty distributions in Python ‘from scratch’

fastai

Here I write up some functions to generate probability univariate and normal probability distributions based on the book Data Science from Scratch

Computational checking of the girl/boy probability problem

fastai

Here I replay the classical two child problem and code it up in Python.

Correlation and covariance from scratch

fastai

In this post we examine covariance and a correlation a bit closer.

Matrix algebra ‘from scratch’ with type annotations

fastai

This is the continuation of yesterday’s practice, but now with Matrix operations.

Vector Algebra ’from scratch” with type annotations

fastai

I looked into Joel Grus’ Data science from Scratch and found his approach really nice as he actively uses type annotations and assertions in his fuctions.

Linear regression ‘from scratch’ to predict Ethereum gas prices from transaction values

fastai

In this post I go through the main steps of how to calculate a simple univariate linear regression model.

Plotting Ethereum transaction value and gas prices with BigQuery and Altair

fastai

As part of getting a better handle on blockchain data, BigQuery, Altair, and Machine Learning, I pulled some Ethereum transaction data and plotted it.

How to use BigQuery in a Jupyter notebook?

fastai

When we try to analyze huge datasets (like blockchain data) through BigQuery, it is useful to run the data load and conversion in the cloud and use our local environment…

Accessing Ethereum token transaction data with `pandas-gbq`

fastai

One way to access blockchain bigquery data with Google BigQuery is to use the pandas-gbq library.

Random prediction

fastai

When we try to build a prediction algorithm, it is a useful practice to first try out a baseline algorithm and see how they perform. Here we will describe a case of random…

How does data standardization work?

fastai

With standardization, we transform the data so its distribution’s center will become 0 and its standard deviation will become 1.

Data scale normalization

fastai

Normalization is a common technique used in machine learning to render the scales of different magnitudes to a common range between 0 and 1.

How to categorize your notes?

note-taking

categorization

hierarchies

concept drift

chaos & order

The pain of organizing your thoughts.

The sum of stock trading

stock trading

zero-sum

finance

valuation

Stock trading might not always be a zero sum game

How to build up a writing habit?

writing

habit

Wondered how to build up a writing habit? Do not know what to write about? These tips might solve this for you.

Is finance a zero-sum activity?

finance

zero-sum

valuation

I was thinking about whether financial exchange relationships are zero-sum or not? This is what I found.

The specific you

self-knowledge

specialization

Why are your specific traits important and how to find them?

Valuation technology experimentation

technology

valuation

experimentation

It might be useful and promising to experiment with technologies of valuation.

Note-taking obsessions

note-taking

One of my core frustration with note taking