joubin's Kardz


Data Science, Python Libraries

  1. Scikit-learn (formerly scikits.learn) is a free machine learning library for Python.
    • This library features:
      • classification algorithm
      • regression algorithm
      • clustering algorithm
      • ... including support for vector machines, random forests, gradient boosting, k-means and DBSCAN.
    • It is designed to interoperate with NumPy and SciPy.
    • http://scikit-learn.org
  2. NumPy is a library for Python, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions to operate on these arrays.
  3. SciPy is a free and open-source Python library used for scientific computing and technical computing.
  4. Matplotlib is a plotting library for Python and its numerical mathematics extension NumPy.
  5. pandas is a software library written for Python for data manipulation and analysis. In particular, it offers data structures and operations for manipulating numerical tables and time series.

Shared by joubin on Wed Jul 25 2018


Web Page Weight

  1. Performance Budget
    • Make performance part of the conversation
    • Measure, Optimize, Monitor, and Repeat
  2. Optimizing this is a journey
  3. Audit and Trim your JS Libraries
  4. Perhaps JS is the most expensive part of a website page
  5. JavaScript has a cost
  6. A JPEG image needs to be decoded, rasterized, and painted on the screen.
    • A JavaScript bundle needs to be downloaded and then parsed, compiled, executed —and there are a number of other steps that an engine needs to complete.
  7. Download time, Parse time, compile time, Execution time

https://medium.com/@addyosmani/the-cost-of-javascript-in-2018-7d8950fbb5d4

Lighthouse: https://developers.google.com/web/tools/lighthouse/

Code-Splitting guidelines:

Shared by joubin on Fri Aug 03 2018

DataFrame

The concept of a data frame comes from the world of statistical software used in empirical research.

It refers to "tabular" data: a datastructure representing cases (rows), each of which consists of a number of observations or measurements (columns).

https://github.com/mobileink/data.frame/wiki/What-is-a-Data-Frame%3F

https://pandas.pydata.org/pandas-docs/stable/generated/pandas.DataFrame.html

Shared by joubin on Fri Jul 27 2018


Azure Cognitive Services APIs

Language:Allow your apps to process natural language, evaluate sentiment and topics, and learn how to recognize what users want.

  • Language Understanding Intelligent Service PREVIEW
  • Bing Spell Check API
  • Translator Speech API
  • Web Language Model API PREVIEW
  • Text Analytics API PREVIEW
  • Translator Text API
  • Linguistic Analysis API

Knowledge: Map complex information and data in order to solve tasks such as intelligent recommendations and semantic search.

  • Recommendations API PREVIEW
  • Custom Decision Service PREVIEW
  • Knowledge Exploration Service PREVIEW
  • Academic Knowledge API
  • QnA Maker API PREVIEW
  • Entity Linking Intelligence Service API PREVIEW

Search: Make your apps, webpages, and other experiences smarter and more engaging with the Bing Search APIs.

  • Bing Autosuggest API
  • Bing Video Search API
  • Bing Image Search API
  • Bing Web Search API
  • Bing News Search API
  • Bing Custom Search

https://azure.microsoft.com/en-us/services/cognitive-services/

Shared by joubin on Wed May 24 2017

Vendor Artificial Intelligence Collaboration

Partnership on AI was formed by a bunch of vendors and 3rd parties to collaborate on AI.

https://www.partnershiponai.org

Shared by joubin on Fri May 26 2017

AI development APIs and tools

  • R
  • scikit-learn
  • TensorFlow from Google
  • Theano library in Python
  • Deeplearning4j for folks who use Java and JVM
  • Packages rpart, glmnet in R are also useful for quick hacks to test an idea
  • spaCy: For natural language processing

Shared by joubin on Fri May 26 2017

stash clear/drop

clear

Remove all the stash entries. Note that those entries will then be subject to pruning, and may be impossible to recover (see Examples below for a possible strategy).

drop [-q|--quiet] [<stash>]

Remove a single stash entry from the list of stash entries. When no <stash> is given, it removes the latest one. i.e. stash@{0}, otherwise <stash> must be a valid stash log reference of the form stash@{<revision>}.

https://git-scm.com/docs/git-stash

Shared by joubin on Mon Jul 09 2018

The 'where' Windows command

Use the where command.

WHERE [/R dir] [/Q] [/F] [/T] pattern...

By default, the search is done along the current directory and in the paths specified by the PATH environment variable.

Parameter List:
/R Recursive

/Q Quiet mode

/F Displays the matched filename in double quotes.

/T Displays the file size, last modified date and time for all
matched files.

Shared by joubin on Mon May 28 2018

Dockerfile

Docker can build images automatically by reading the instructions from a Dockerfile.

Dockerfile is a text document that contains all the commands a user could call on the command line to assemble an image.

Using docker build users can create an automated build that executes several command-line instructions in succession.

https://docs.docker.com/engine/reference/builder/

Shared by joubin on Tue May 29 2018


Html submit button formaction attribute

The formaction attribute specifies where to send the form-data when a form is submitted.

This attribute overrides the form's action attribute.

The formaction attribute is only used for buttons with type="submit".

The formaction attribute is new in HTML5.

https://www.w3schools.com/tags/att_button_formaction.asp

Shared by joubin on Tue May 08 2018

Visual Studio Code shortcuts

Ctrl + Shift + P => Command Palette

Ctrl + Shift + X => Extenstions

Ctrl + ` => Integrated Terminal (? Ctrl + J)

Ctrl + B => Toggle Sidebar (right)

Alt + Left Arrow Key => Previous cursor location

Alt + Right Arrow Key => Next cursor location

Ctrl + P => Go to file

F12 => Go to definition

Ctrl + F12 => Go to Implmentation

Ctrl + K, S => Save All





Shared by joubin on Tue May 08 2018

PowerShell and TLS1.2

PowerShell user TLS1.0 by default and if you try Invoke-RestMethod to an HTTPS endpoint, you will get:

Invoke-RestMethod : The underlying connection was closed: An unexpected error occurred on a send

To force PS to use TLS1.2, execute the following:

[Net.ServicePointManager]::SecurityProtocol = [Net.SecurityProtocolType]::Tls12;

https://www.codyhosterman.com/2016/06/force-the-invoke-restmethod-powershell-cmdlet-to-use-tls-1-2/

Shared by joubin on Fri May 04 2018

TSQL, Composite Primary Key

Alter table TABLENAME 
Add Constraint PK_COL1_COL2_COL3
Primary Key Clustered (COL1, COL2, COL3)

Shared by joubin on Wed May 02 2018

Emmet

Emmet is a set of plug-ins for text editors that allow for high-speed coding and editing in HTML, XML, XSL, and other structured code formats via content assist.

Formerly known as Zen Coding.

Emmet is primarily independent from any text editor, as the engine works directly with text rather than with any particular software.

Reference: https://en.wikipedia.org/wiki/Emmet_(software)

Project site: https://emmet.io/

Shared by joubin on Wed May 02 2018

Kubernetes Architecture Overview









Shared by joubin on Mon Feb 19 2018

cgroups

cgroups is a Linux kernel feature that limits, accounts for, and isolates the resource usage (CPU, memory, disk I/O, network, etc.) of a collection of processes.

Engineers at Google (primarily Paul Menage and Rohit Seth) started the work on this feature in 2006 under the name "process containers".

In late 2007, the nomenclature changed to "control groups" to avoid confusion caused by multiple meanings of the term "container" in the Linux kernel context, and the control groups functionality was merged into the Linux kernel mainline in kernel version 2.6.24, which was released in January 2008. Since then, developers have added many new features and controllers, such as support for kernfs in 2014, firewalling, and unified hierarchy.

Shared by joubin on Sun Apr 29 2018

EAV Model

The Entity-Attribute-Value model or EAV is also sometimes referred to at the Object-Attribute-Value Model, or even the Open Schema.

This is a data model that is often used in instances where the amount of attributes, properties, or parameters that can be used to define an entity are potentially limitless.

Attributes are defined disconnected from entities. The values table link back to the attribute and the entity itself.

http://www.learn.geekinterview.com/it/data-modeling/entity-attribute-value-eav.html

Shared by joubin on Fri Jan 26 2018