Skip to content

Notepad

Staging area - Start with H1, later move to term-notes.md

Android Notes

ADB is utility to interact with android phone. It can install/uninstall apks. change connections etc. All commands here, adb shell.

Enable Developer Options > USB Debugging

adb must be installed on your mac/pc.

Uninstall blotwares

  • adb devices see your device
  • adb shell enter phone shell
  • pm uninstall -k --user 0 com.mipay.wallet.in to use pm is pkg mgr, and uninstall an app.

References:

Easy Soft Sys

Color Pallet:

Font: Gill Sans Nova Extra Condensed Bold

Bookdown

Quick getting started.

Steps:

  • mkdir bookdown
  • cd bookdown/
  • git clone https://github.com/seankross/bookdown-start
  • cd bookdown-start/
  • r
  • bookdown::render_book("index.Rmd")
  • all # heading 1 are chapters.
  • Add Part I before a chapter to make it part in a book, # (PART) Data Science {-}
  • > options(bookdown.render.file_scope = FALSE); to use parts in diff directories.

To support GitHub flavoured MarkDowm, you need to add the following line to _output.yml file:

md_extensions: +lists_without_preceding_blankline+pipe_tables+raw_html+emoji

Working on a book:

  • All mds are in ./data_science folder.
  • All images are in ./images folder.
  • Add new md file to ./_bookdown.yml file. It also has index order.
  • To build and run:
    • r
    • bookdown::render_book("index.Rmd")
    • new site availabe at ./docs/index.html
    • quit() to exit R shell

References:

Digital Marketing Notes

Instagram page earning:

  • original images
  • regular posting

Instagram Bot:

Tableau

Writeback in Tableau

## Mega String

"( '"
+[CC interaction_ID]
+"', '"
+[CC Status]
+"', '"+[CC Note]+"', '"+USERNAME()+"' )"

## HideInsert

[CC W InsertRun] = 0

## HideReset

[CC W InsertRun] = 4

## IncrementAdd

[CC W Incrementer]+1

## zero

0

## One

1

## Blank

""

## sheet reset

Saved successfully!
Go To Flow View ⮞

## Seet Sumbit

Submit ⮟

## CC Submitted

Writeback proc source

## Actions on form

select - reset - go to - next

select - reset - set - insertrun to 0

select - submit - set - cc mega string

select - submit - set - increment to +1

select - submit - set - insetRun 1

## actions on table sheet

select - table - set - insertRun 1

select - table - set - string blank

select - table - set - id to row selected

D3

Add D3 library. Then specific module.

  • it is collection of module that work together
  • data is bounded to the selections, it join-by-index
  • By default, the data join happens by index: the first element is bound to the first datum, and so on. Thus, either the enter or exit selection will be empty, or both. If there are more data than elements, the extra data are in the enter selection. And if there are fewer data than elements, the extra elements are in the exit selection.
  • selectAll() data() enter() append() - to add elements, SDEA. https://observablehq.com/@d3/d3-hierarchy?collection=@d3/d3-hierarchy

ObservableHQ:

  • Live, web edit, d3 notebooks.
  • markdown and JS blocks
  • lots of d3 features. like counts, action buttons etc
  • can make dasboard as well.

YouTube Channel Notes

Start creating a web of terms , make understand each thing, chamkao cheezo ko. makeit understnad to 6yr old guy start from docs, make reading a habit, start taking notes. math teacher lessongs, i see, i do, i ... small age learn, big understand, then decision.

Follow:

DWBI

  • DW is creating a dimentional model of data that lets users easily ask questions.
  • Data is identified as DIm and Facts then stored as star schema
  • Facts are aggregatabe, or can be factless
  • Dimensions have primary-key, natural-key, surrogate-key. PK is simple numerical increment.
    • The degenerate dimension is a dimension key without a corresponding dimension table. So a order-number in fact table is a dimension key without a dimention table.
    • Natural Key has a meaning, like Emp-ID, while surrogate keys are numneric that start from 1 and increment by 1. These meaning less surrogate keys should be used for join between facts and dimensions.

  • Four Steps to do dimentional modelling

    • 1 - Identify the business process
      • what do you want to understand
      • Eg:
        • as a retail owner, i want to customer purchases at POS, so that I can analyze products selling, stores and promotions.
    • 2 - Identify the grain
      • lowest atomic grain is best because it its highly dimensional hence gives more information
      • Eg:
        • Retail - individual product on POS transaction
    • 3 - Identify the dimensions
      • they are determined automatically once we have the grain identified, if dimension breaks the grain futher then discard it or revisit grain statement.
    • 4 - Identify the facts, anything not in same grain goes to another fact table.
  • Date Dimension
    • it has date attributes like Date Key (PK), Date, Day of Week, Holiday Indicator, Weekday Indicator, Day in Month, Day in Year, Last Day in Month Indicator, Week Ending Date, Week in Year, Month Name, Month in Year, Year-Month (YYYY-MM), Quarter, Year-Quarter, Year
    • date is stored separately as dimension because it can help keep date-calculations in advance. Eg, a date can have, different formats, is-weekday?, is-holiday?, week-number, day-in-year?, day-of-week and many more. it helps to keep calendar-logic in dimension rather tahn application. Can have holiday indicator. Roughtly 20years of date can be listed in 7,300 rows.
    • time-of-day - it should be date-time fact in fact table to avoid explosion of date dimention, if required to keep it as dimension, it can be separate dimension as time-of-day.
  • Product Dimension
    • it can have attributes relate to procust like Product Key (PK), SKU Number (NK), Product, Brand, Subcategory, Category, Department Number, Department, Package Type, Package Size, Fat Content.
    • it has merchandise hierarchy flattened out. Typically, individual SKUs roll up to brands, brands roll up to categories, and categories roll up to departments.
    • List-Price is numeric but can be in dim as it is not additive and doesn't change on event, or is not event driven. It can be added once we know qunitity or weight at event. Or for some case it can be stored both in fact and dimension.
    • a typical product dimension can have 50+ attributes and 300,000+ SKUs.
    • Master File - In large grocery business, there can be a product master file where you can manage all products for all stores and then individual stores can pull a subset from it.
  • Store Dimension
    • It can store attributes like Store Key (PK), Number (NK), Name, Street Address, City, County, City-State, State, Zip Code, Manager, District, Region. You can see there is a hierarchy here.
  • Promotion Dimension

Home Lab

  • Proxmox
    • Proxmox is virtualization without OS. Proxmox is itself like a OS similar to Virtual Box
    • Once installed it can be accessed from web or shell.
    • From Web, you can create vm, upload iso for vm, define vm hardware requirements, network configs etc.
    • VM can be accessed using shell or vnc via web browser.
    • Proxmox provides easy container creation with pre-built templates.
  • QEMU and KVM
    • This can be installed on linux, like On ubunut server (host).
    • using cmd line we can craete new vms, provide configs.
    • using ip:port we can open these vms on web using vnc.
  • Docker
    • container starts runs commands and exits, to make it run continuously, config has to be made, like container as web server.
    • you can start multiple container with same image, they are all isolated and can be identical. it helps scaling.
  • Go to r/homelab for more.

Flask LL

  • has .flaskenv
  • data passsed to templates is json.
  • templates, has includes having footer and nav. manin is layout,htmk. other extend it, and add block content.
  • Req and res are all JSON API format.

Home Ubuntu Server

  • System disk SSD, Storage disk HDD, is good.
  • Services you offer should be reliable which requires to give thoughts deeply.
  • Static IP Adress can be manual or via DHCP if you have a router.
  • SSH shell is real shell and if it gets terminated in between of task, the task is lost and may make system currupt. To come over this, use tmux.
  • tmux is a virtual shell that shows real shell that keeps running until a system is running or you terminate it. A shell open in tmux and be disconnected and reconnected to begin from same place as you disconnected at.
  • Never interrupt a apt upgrade process. It can damage the system.
  • It is good to set important security upgrades to run automatically.
  • Snap - is app package with dependencies bundles and works for any distribution. It is platform independent.
    • easy to install, updates automatically.
  • User Accounts
    • human accounts
    • many services need account to run, they create during installation or you can create manually.
  • Services
    • run in a process, they have parent process to.
  • Power Management
    • UPS should be used. UPS comes with USB attachement, that lets ubnutu server know that it is running on battery and if battery if below a certain level you can configure server to gracefully shutdown.
  • Cockpit - systme management via web
  • Samba - File sharing locally
  • KVM/QEMU - to run VMs
  • Container - LCX or Docker - Docker preferred.
  • Media - jellyfin/plex on docker. Jellyfin config and settings can be on server, so that whenever new image is available on docker hub, we can pull it, while config and cache can be picker from the server. Build two folders in /srv/jellyfin/{config/cache}, map both of these as volume to docker. Add another volumen to container which will have media, thsi can be on server or any path on network. Make this docker container run on reboot automatically by option reboot always or via adding systemd.
  • File Sharing - NextCloud
2025-01-12 January 12, 2025