Cybrary Cryptography.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "toc": "true"
   },
   "source": [
    "# Table of Contents\n",
    " <p><div class=\"lev1 toc-item\"><a href=\"#--Course-Title:-Cryptography\" data-toc-modified-id=\"--Course-Title:-Cryptography-1\"><span class=\"toc-item-num\">1&nbsp;&nbsp;</span> <span class=\"girk\"> Course Title: Cryptography</span></a></div><div class=\"lev2 toc-item\"><a href=\"#Section-1-1-Topic:-Introduction-To-Cryptography\" data-toc-modified-id=\"Section-1-1-Topic:-Introduction-To-Cryptography-11\"><span class=\"toc-item-num\">1.1&nbsp;&nbsp;</span>Section 1-1 Topic: Introduction To Cryptography</a></div><div class=\"lev2 toc-item\"><a href=\"#Learning-Objectives:-This-introduction-video-provides-an-outline-of-the-curriculum-covered-in-Cybrary’s-in-depth-Cryptography-course.\" data-toc-modified-id=\"Learning-Objectives:-This-introduction-video-provides-an-outline-of-the-curriculum-covered-in-Cybrary’s-in-depth-Cryptography-course.-12\"><span class=\"toc-item-num\">1.2&nbsp;&nbsp;</span>Learning Objectives: This introduction video provides an outline of the curriculum covered in Cybrary’s in-depth Cryptography course.</a></div><div class=\"lev2 toc-item\"><a href=\"#Section-1-2-Topic:-Key-Concepts-of-Cryptography:-PKIS-&amp;-Encryption\" data-toc-modified-id=\"Section-1-2-Topic:-Key-Concepts-of-Cryptography:-PKIS-&amp;-Encryption-13\"><span class=\"toc-item-num\">1.3&nbsp;&nbsp;</span>Section 1-2 Topic: Key Concepts of Cryptography: PKIS &amp; Encryption</a></div><div class=\"lev2 toc-item\"><a href=\"#Keys\" data-toc-modified-id=\"Keys-14\"><span class=\"toc-item-num\">1.4&nbsp;&nbsp;</span>Keys</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-1-3-Topic:-Introduction-to-Cryptographic-Tools\" data-toc-modified-id=\"Section-1-3-Topic:-Introduction-to-Cryptographic-Tools-2\"><span class=\"toc-item-num\">2&nbsp;&nbsp;</span>Section 1-3 Topic: Introduction to Cryptographic Tools</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-1-4-Topic:-Services-&amp;-Threats-of-Cryptography\" data-toc-modified-id=\"Section-1-4-Topic:-Services-&amp;-Threats-of-Cryptography-3\"><span class=\"toc-item-num\">3&nbsp;&nbsp;</span>Section 1-4 Topic: Services &amp; Threats of Cryptography</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-1-Topic:-Integrity-Checking:-Modifications\" data-toc-modified-id=\"Section-2-1-Topic:-Integrity-Checking:-Modifications-4\"><span class=\"toc-item-num\">4&nbsp;&nbsp;</span>Section 2-1 Topic: Integrity Checking: Modifications</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-2-Topic:-CipherText\" data-toc-modified-id=\"Section-2-2-Topic:-CipherText-5\"><span class=\"toc-item-num\">5&nbsp;&nbsp;</span>Section 2-2 Topic: CipherText</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-3-Topic:-Master-Pattern-Analysis-with-CrypTool\" data-toc-modified-id=\"Section-2-3-Topic:-Master-Pattern-Analysis-with-CrypTool-6\"><span class=\"toc-item-num\">6&nbsp;&nbsp;</span>Section 2-3 Topic: Master Pattern Analysis with CrypTool</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-4-Topic:-Symmetric-Encryption\" data-toc-modified-id=\"Section-2-4-Topic:-Symmetric-Encryption-7\"><span class=\"toc-item-num\">7&nbsp;&nbsp;</span>Section 2-4 Topic: Symmetric Encryption</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-5-Topic:-Stream-Ciphers,-XOR-and-RC4\" data-toc-modified-id=\"Section-2-5-Topic:-Stream-Ciphers,-XOR-and-RC4-8\"><span class=\"toc-item-num\">8&nbsp;&nbsp;</span>Section 2-5 Topic: Stream Ciphers, XOR and RC4</a></div><div class=\"lev2 toc-item\"><a href=\"#Plain-|-Plaintext-key-|-Cipher-|-\" data-toc-modified-id=\"Plain-|-Plaintext-key-|-Cipher-|--81\"><span class=\"toc-item-num\">8.1&nbsp;&nbsp;</span>Plain | Plaintext key | Cipher | </a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-6-Topic:-Pros-and-Cons-of-Symmetric-Cryptography\" data-toc-modified-id=\"Section-2-6-Topic:-Pros-and-Cons-of-Symmetric-Cryptography-9\"><span class=\"toc-item-num\">9&nbsp;&nbsp;</span>Section 2-6 Topic: Pros and Cons of Symmetric Cryptography</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-2-7-Topic:-Public-Key-Cryptography\" data-toc-modified-id=\"Section-2-7-Topic:-Public-Key-Cryptography-10\"><span class=\"toc-item-num\">10&nbsp;&nbsp;</span>Section 2-7 Topic: Public Key Cryptography</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-1-Topic:-Asymmetric-Cryptography-Functions\" data-toc-modified-id=\"Section-3-1-Topic:-Asymmetric-Cryptography-Functions-11\"><span class=\"toc-item-num\">11&nbsp;&nbsp;</span>Section 3-1 Topic: Asymmetric Cryptography Functions</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-2-Topic:-Public-Key-Exchange\" data-toc-modified-id=\"Section-3-2-Topic:-Public-Key-Exchange-12\"><span class=\"toc-item-num\">12&nbsp;&nbsp;</span>Section 3-2 Topic: Public Key Exchange</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-3-Topic:-Advanced-Encryption-Package\" data-toc-modified-id=\"Section-3-3-Topic:-Advanced-Encryption-Package-13\"><span class=\"toc-item-num\">13&nbsp;&nbsp;</span>Section 3-3 Topic: Advanced Encryption Package</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-4-Topic:-Hashing-and-Hash-Collisions\" data-toc-modified-id=\"Section-3-4-Topic:-Hashing-and-Hash-Collisions-14\"><span class=\"toc-item-num\">14&nbsp;&nbsp;</span>Section 3-4 Topic: Hashing and Hash Collisions</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-5-Topic:-Hash-Calc\" data-toc-modified-id=\"Section-3-5-Topic:-Hash-Calc-15\"><span class=\"toc-item-num\">15&nbsp;&nbsp;</span>Section 3-5 Topic: Hash Calc</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-6-Topic:-Digital-Signature,-SHA2(256)-and-RSA\" data-toc-modified-id=\"Section-3-6-Topic:-Digital-Signature,-SHA2(256)-and-RSA-16\"><span class=\"toc-item-num\">16&nbsp;&nbsp;</span>Section 3-6 Topic: Digital Signature, SHA2(256) and RSA</a></div><div class=\"lev1 toc-item\"><a href=\"#Section-3-7-Topic:-Hash-My-Files\" data-toc-modified-id=\"Section-3-7-Topic:-Hash-My-Files-17\"><span class=\"toc-item-num\">17&nbsp;&nbsp;</span>Section 3-7 Topic: Hash My Files</a></div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    " <h1> <span class=\"girk\"> Course Title: Cryptography</span></h1>\n",
    "\n",
    "\n",
    "\n",
    "\n",
    "## Section 1-1 Topic: Introduction To Cryptography\n",
    "\n",
    "## Learning Objectives: This introduction video provides an outline of the curriculum covered in Cybrary’s in-depth Cryptography course.\n",
    "\n",
    "* Confidentiality, Integrity, Availability and Authentication\n",
    "\n",
    "* How companies use cryptography\n",
    "\n",
    "* How penetration testers can also use cryptography\n",
    "\n",
    "* Tools, Techniques and Attacks\n",
    "\n",
    "* Academics discusses history of encryption.\n",
    "\n",
    "* Academics simply encrypt or hash, why aren’t people using hashing more?\n",
    "\n",
    "* Professional is just, encrypt or not, hash or just verify\n",
    "\n",
    "## Section 1-2 Topic: Key Concepts of Cryptography: PKIS & Encryption\n",
    "\n",
    "* Learning Objectives: Cryptography is one of the most underrated courses of study in the industry. Of those who do study it, issues with comprehension tend to hinder individual mastery. By taking this course, learners will finally be able to grasp all the critical concepts, theories and practices associated with Cryptography.\n",
    "\n",
    "* This Cryptography presentation discusses and demonstrates the key concepts of Cryptography from attacks, PKIs and Encryption in detail.\n",
    "\n",
    "* You’ll learn about the difference between public and private keys and about the similarities and differences between symmetry & asymmetry. We’ll also discuss the concept of integrity and confidentiality and their relationships to/with protocols.\n",
    "\n",
    "* This Cybrary Cryptography course will help you master the basics of Cryptography as you begin to develop the discipline needed to become an accomplished pen tester.\n",
    "\n",
    " Keys and Principles\n",
    "\n",
    "\n",
    "## Keys\n",
    "\n",
    "1. Symmetric – also referred to as same keys, private key, symmetric key – same (confidentially)\n",
    "\n",
    "Different Version/Ways/Procedures to get PlainText to CipherText\n",
    "\n",
    "* **Symmetric Cipher Examples:**\n",
    "\n",
    "AES, DES, 3DES, IDEA, CAST, twofish, Blowfish, RC2, Serpent, Rijndael – (there are others, chart at end of section)\n",
    "\n",
    "PGP, OTP (One Time password)\n",
    "\n",
    "* Mnemonic device to remember some Symmetric Ciphers (how it reads, sounds and then corresponds, in English):\n",
    "Hey! These 3 guys, had an idea to cast their rod to fish for blowfish, but instead received, serpents in the rain. A! Dees 3 guys, had an IDEA to CAST their rod TWOFISH for BLOWFISH, but instead Received, Serpents in the Rain.\n",
    "\n",
    "AES DES 3DES IDEA  CAST  TWOFISH  BLOWFISH  RC2 Serpent          Rijndael\n",
    "\n",
    "* Asymmetric – public/private key pair – what one key does, the other key undoes\n",
    "\n",
    "(confidentially, authentication, nonrepudiation)\n",
    "\n",
    "* **Asymmetric Cipher Examples:**\n",
    "\n",
    "DH (key exchange), El Gamal (open source), RSA (internet), Elliptical Curve (for limited processor machines),\n",
    "Knapsack, DSA (popular as a US standard)\n",
    "\n",
    "* Mnemonic device to remember some Asymmetric Ciphers (how it reads and then corresponds, in English):\n",
    "\n",
    "D-E-R-E-K-S\n",
    "Diffie Hellman, El Gamal, RSA, Elliptical Curve, Knapsack, DSA\n",
    "\n",
    " 2. Principles (C, I, A)\n",
    "\n",
    "Principles of CIA (confidentiality, integrity and authentication) along with PAIN will be discussed in detail later, focus on concepts and definitions.\n",
    "\n",
    "Substitution/Transposition – PlainText to CipherText, and CipherText to PlainText\n",
    "\n",
    "Disk Encryption (further detail later)\n",
    "\n",
    "* **Integrity**\n",
    "\n",
    "Detect unauthorized change via output of Message Digest, also known as, a hash.\n",
    "MD5 (128bit), SHA (160 bit, also variable), Hashing Calculator\n",
    "\n",
    "* **PKI** \n",
    "\n",
    "A public key infrastructure (PKI) is a set of hardware, software, people, policies, and procedures needed to create, manage, distribute, use, store, and revoke digital certificates and manage public-key encryption.\n",
    "\n",
    "CA, RA, X.509\n",
    "\n",
    "* IKE (internet Key exchange), ISAKMP, CRL (certification revocation list), OCSP (dynamic, checks x.509 cerrtification)\n",
    "\n",
    "* Attacks\n",
    "\n",
    "    * Known Plaintext\n",
    "\n",
    "    * Known CipherText\n",
    "\n",
    "    * Chosen CipherText (needs physical access to machine)\n",
    "\n",
    "    * Chosen Plaintext (choose what gets decrypted, needs physical access to)\n",
    "\n",
    "* Protocols\n",
    "\n",
    "    * SSH (replaced Telnet)\n",
    "\n",
    "    * HTTPS (SSL/TLS with security protocol, wraps all upper layer application in cryptographic wrapper)\n",
    "\n",
    "    * IPSec (Network Layer, analogy truck: authentication header/integrity check, payload: integrity check and confidentiality check)\n",
    "\n",
    "    * SSL/TLS (protocols) \n",
    "\n",
    "* **Symmetric Ciphers**\n",
    "\n",
    "\n",
    " Key | Length |\n",
    "--- | --- | ---\n",
    "Blowfish | 1-448 bits\n",
    "DES | 56 bits\n",
    "IDEA | 128 bits\n",
    "RC4 1-2048 buts\n",
    "RC5 128-256 bits\n",
    "Rijndael 128-256 bits\n",
    "Serpent | 128-256 bits\n",
    "Triple | (3) DES 168 bits\n",
    "Twofish | 128-256 bits\n",
    "\n",
    "\n",
    "\n",
    "# Section 1-3 Topic: Introduction to Cryptographic Tools\n",
    "\n",
    "\n",
    "# Section 1-4 Topic: Services & Threats of Cryptography\n",
    "\n",
    "\n",
    "\n",
    "# Section 2-1 Topic: Integrity Checking: Modifications\n",
    "\n",
    "* Learning Objectives: These videos, while separate, build on each other and are all linked. Explain how cryptography is used to protect CIA.  ‘CIA’ can also be a ‘PAIN’ – all defined…\n",
    "\n",
    "1. Confidentiality (C of CIA) (also Privacy, P of PAIN) – prevent unauthorized disclosure of data Threats\n",
    "\n",
    "    * Social Engineering: Opening Unsigned Emails (Spear Phishing, Whaling Attack)\n",
    "        * Defense Controls: Physical, Technical, Mail Filter, Administrative Training\n",
    "        * Ideas: Separation of Duties, Need to Know\n",
    "\n",
    "    * Media Reuse: USB Thumb Drive reuse is common.\n",
    "\n",
    "        * Sanitizing can also be referred to as Zero’ing, \n",
    "        * Destroying a hard drive, completely, requires incineration.\n",
    "        * Degaussing method only works for Magnetic Media.\n",
    "        * Deleting only removes pointer to file and Formatting can be recovered.\n",
    "\n",
    "    * Eavesdropping: protocol (packet) analyzer/ sniffer. Wireshark is popular.\n",
    "\n",
    "        * Replay Attack: Capturing a packet that contains a password and reusing;\n",
    "        * This allows access to ‘use’ a password without never knowing the actual password\n",
    "        * Zero Knowledge Proof: Kerberos allows end user to prove the password, without sending password across network\n",
    "        * Hack Attack Discussion: Directory Services: Query DNS, reply to send Credential to Server 1\n",
    "\n",
    "2. Integrity (I of CIA, I of PAIN)\n",
    "\n",
    "    * Accidental Modifications are checked by message digests, or hashes. (digital representation of file – checks if identical)\n",
    "    * Intentional (Malicious) Modification can be checked by using:\n",
    "    * Message Authentication Code (MAC) or\n",
    "    * Digital Signatures (both provide an extra step of authentication)\n",
    "\n",
    "3. Authenticity (A of CIA, A of PAIN)\n",
    "\n",
    "    * How to prove is truly came from the sender, is it valid?\n",
    "\n",
    " 4. Non repudiation (N of PAIN)\n",
    " \n",
    "    * Combination of Integrity and Authenticity – must have both!\n",
    "    * Sender can’t dispute sending the message or contents – we use digital signatures for this (further detailed explanations will follow on how)\n",
    "\n",
    "**Mnemonic Device, some remember it as CIA, or PAIN – P(rivacy) A(uthentication) I(ntegrity) N(on Repudiation)**\n",
    "\n",
    "# Section 2-2 Topic: CipherText\n",
    "\n",
    "* Learning Objectives: Learn how to properly create CipherText and the processes behind it in this lecture series on Cryptography.\n",
    "\n",
    "    * Privacy/Confidentiality\n",
    "    * Plaintext + Initialization Vector + Algorithm + Key = CipherText\n",
    "    * Plaintext is just plain, non-encrypted text or data.\n",
    "    * Initialization Vector (IV) adds randomness and complexity.  Randomized Starting Point\n",
    "        * Computer cannot generate a random number, so we have a pseudo random number. pseudorandom is not truly random but it is pseudo random \n",
    "        * We could take any number of variable pieces of data to generate a pseudo random number such as:\n",
    "```\n",
    "A Date: 12/12/1999 would be 34.\n",
    "```\n",
    " \n",
    "* Algorithm (aka Cipher, is a collection of math functions)\n",
    "\n",
    "    * Symmetric Cryptography can also be referred to as:\n",
    "\n",
    "        * Private Key\n",
    "        * Secret Key\n",
    "        * Session Key\n",
    "        * Shared Key (i.e. shared between two parties)\n",
    "    * **Any Symmetric Algorithm, to be discussed later, will be either:**\n",
    "        * Block\n",
    "        * Stream\n",
    "    * Asymmetric\n",
    "        * Discrete logarithms\n",
    "        * Factorization\n",
    "\n",
    "\n",
    "* Key (Crypto Variable) is the instruction on how to use the algorithm (how to use the math) the key should also be a randomised.\n",
    "\n",
    "# Section 2-3 Topic: Master Pattern Analysis with CrypTool\n",
    "\n",
    "Learning Objectives: Learn how to perform pattern analysis with CryptTool to identify trends during the encryption process.\n",
    "* CrypTool Lab\n",
    "* CrypTool is a non-academic analysis tool that offers a fundamental understanding of encryption algorithms.\n",
    "* Can be found at: http://www.cryptool.org\n",
    "\n",
    "# Section 2-4 Topic: Symmetric Encryption\n",
    "\n",
    "* Learning Objectives: The Symmetric Encryption discussion opens by reviewing the usage of random numbers, explaining what Replay Attack is, the importance of unique information on data packets and in sequencing and defining key terms including Nonce and Key Generation.\n",
    "\n",
    "* Then, you’re introduced to Symmetric Encryption with a basic summary of how it works, what ciphers are, the different types of Symmetric Ciphers, what happens with block ciphers, and what the difference means to encryption and decryption as a process.\n",
    "\n",
    "* As a penetration tester, you must know the difference between confusion and diffusion.  You’ll observe how that correlates to how algorithms work and the importance of strong math in configuring algorithms.  And you’ll learn what happens as algorithms are used and what you need to look for in your testing results.\n",
    "\n",
    "* Cryptographic Uses of Random Numbers\n",
    "    * There is very little true randomness (or entropy) so instead we use pseudo random.\n",
    "    * Nonces – process of stamping uniqueness on packet without being sequential.\n",
    "* Note: Adds uniqueness and helps to stop replay attacks\n",
    "    * Key Generation – keys must be unique, (pseudo) random and of a suitable length\n",
    "* Note: All things being equal, longer will offer more protection.\n",
    "\n",
    "* Symmetric Encryption (same key on both ends – real world example: a house key)\n",
    "* Ciphers\n",
    "* Confusion – Confusion relates to complex math and substitution\n",
    "* Diffusion – Diffusion relates to permutations or rounds\n",
    "* (DES went through 16 rounds, 3DES goes through 48 times/rounds/permutations)\n",
    "* Bit length is not necessarily the final determination of the strength of a key.\n",
    "* Open – Kerckhoffs Principles, algorithm should be open\n",
    "* Key Generation – (definition above)\n",
    "\n",
    "* **Example Algorithm:**\n",
    "```\n",
    "[R1]+2, [R2]-2, [R3]*2, [R4]/2, … [R6]^2 – each [R] would be considered an SBox (or substitution box)\n",
    "```\n",
    "* Block Ciphers (slower, but more secure)\n",
    "\n",
    "* ECB\n",
    "* CBC\n",
    "* DES\n",
    "* 3DES (secure, very process intensive, but AES would be preferred)\n",
    "* AES (Advanced Encryption Standard)\n",
    "\n",
    "# Section 2-5 Topic: Stream Ciphers, XOR and RC4\n",
    "\n",
    "Learning Objectives: As a continuation of learning about Symmetric Encryption, this lesson explores the other type of cipher: Stream Ciphers. \n",
    "\n",
    "We’ll go much deeper into what happens during XOR (which stands for exclusive Or), what transposition and substitution is, and whether or not multiple transposition and substitution is preferred. You’ll also observe a rich demonstration of how XOR provides encryption, learn what RC4 is and what takes place at the encryption and decryption level.\n",
    "\n",
    "As a Penetration Tester, you must understand the key functions of each of these events, what their impact is on each other and how to determine when to use one over another in Symmetric Encryption.\n",
    "\n",
    "* **StreamCiphers**\n",
    "\n",
    "One bit at a time \n",
    "Transposition (THE becomes HET; moving over 1 character)\n",
    "\n",
    "Substitution (A for T, B for H, C for E, assigning different characters, etc.),\n",
    "* XOR (Exclusive Or)\n",
    "\n",
    "* How XOR works, since it is a stream, it goes bit by bit\n",
    "\n",
    "XOR Example\n",
    "\n",
    "Plain | Plaintext key | Cipher | \n",
    "--- \n",
    "\n",
    "| 1 | 0 | 1 |\n",
    "| 1 | 1 | 0 | \n",
    "1 | 0 | 1\n",
    "1 | 0 | 1\n",
    "0 | 1 | 1\n",
    "1 | 1 | 0\n",
    "1 | 0 | 1\n",
    "0 | 0 | 0\n",
    "\n",
    "\n",
    "\n",
    "If alike, becomes 0. If different becomes 1\n",
    "\n",
    "                                A real world example could be WEP/WPA which uses RC4\n",
    "\n",
    "                                                (fast encryption and decryption, trades security for speed)\n",
    "\n",
    "                                WPA2 uses AES which is more secure.\n",
    "\n",
    "# Section 2-6 Topic: Pros and Cons of Symmetric Cryptography\n",
    "\n",
    "Learning Objectives: As we wrap up our lesson on Symmetric Cryptography, we must address the pros and cons of this encryption method.\n",
    "\n",
    "You’ll discuss its greatest pro—speed. But as we know, sometimes being too fast occurs at a cost. Those costs will be discussed when we cover the cons of Symmetric Cryptography, such as Out of Band Key Distribution, lack of authenticity, issues with integrity, and non-repudiation.\n",
    "\n",
    "Knowing what the boundaries are with your encryption resources will enable you to make accurate decisions and advise decision-makers with specific points of fact.\n",
    "\n",
    " Con:\n",
    "\n",
    "                Out of band key distribution (no straight forward means of key exchange)\n",
    "\n",
    "                Not Scalable (every unique conversation requires a key)\n",
    "\n",
    "                No ‘A’uthenticity (no court room authenticity, both parties share the key)\n",
    "\n",
    "                No ‘I’ntegrity (corruption happens, it cannot detect corruption or packet drops)\n",
    "\n",
    "                No ‘N’on Repudiation (requires both Authenticity and Integrity)\n",
    "\n",
    "Pro:\n",
    "\n",
    "                Does provide ‘P'(rivacy/Confidentiality) of ‘PAIN’\n",
    "\n",
    "                FAST, FAST, FAST! (It can be noticably real world faster)\n",
    "\n",
    "# Section 2-7 Topic: Public Key Cryptography\n",
    "\n",
    "Learning Objectives: This final lesson in Section 2 of the Cryptography module focuses on public key cryptography.\n",
    "\n",
    "Every user on the network is given a public and private key for encryption. This lesson discusses how the public and private key exchange happens, how Asymmetric Cryptography works, what has to happen so that public and private key exchanges can authenticate, and what the advantage/disadvantages are to employing Asymmetric Cryptography.\n",
    "\n",
    "And finally, there is a contrast discussion on Symmetric vs. Asymmetric Cryptography discussion introducing how penetration testers can get the best out of both worlds.\n",
    "\n",
    " Public Key Cryptography\n",
    "\n",
    "                Two keys issued to each user (simplified example)\n",
    "\n",
    "                                ~1 public key and 1 private key (a key pair)\n",
    "\n",
    "                                Done automatically at the application layer with Outlook, Browser, etc.\n",
    "\n",
    "                Anything encrypted with one key (public) can only be decrypted with the other (private) and vice versa\n",
    "\n",
    "                Provides key exchange, scalability and non-repediation\n",
    "\n",
    "                SLOW\n",
    "\n",
    "# Section 3-1 Topic: Asymmetric Cryptography Functions\n",
    "\n",
    "Learning Objectives: As we wrap up our lesson on Cryptography, we spend our last section exploring Asymmetric Cryptography in detail with several labs to supplement the lecture knowledge.\n",
    "\n",
    "A penetration tester must be able to understand what happens at each stage of encryption/decryption phase and how those transactions affect or trigger the outcomes of other events. \n",
    "\n",
    "In this session, we learn how Asymmetric Cryptography delivers all four encryption services: privacy, authenticity, integrity, non-repudiation (PAIN). We’ll then we find out what happens at each state of asymmetric cryptography.\n",
    "\n",
    "At the conclusion of this lesson, you’ll know what info is exchanged between public and private key, how packet verification occurs, how a hash is created and how hashing algorithms are used.\n",
    "\n",
    " Asymetric Cryptography P.A.I.N.\n",
    "\n",
    "* **Privacy**\n",
    "\n",
    "\n",
    "    * Sender always encrypt with the receiver’s PUBLIC key.\n",
    "    * Receiver decrypts with receiver’s PRIVATE key which only that receiver has.\n",
    "\n",
    "\n",
    "* **Authenticity**\n",
    "\n",
    "\n",
    "    * Sender will encrypt “something” with the sender’s PRIVATE key.\n",
    "    * When the receiver is able to successfully decrypt that ‘something’ with that sender’s PUBLIC key,that proves it was encrypted with the sender’s PRIVATE key, which only the sender has.\n",
    "    * Example: I am sending message; my content is encrypted with receiver’s public key. The time stamp is encrypted with senders (my) private key – this can prove that *I* sent it.\n",
    "\n",
    "* **Integrity**\n",
    "\n",
    "    * Create a message digest (hash) with a hashing algorithm  (MD5:128 bit; used less, SHA-1:160 bit; used less, SHA 256:256 bit) Asymmetric and Symmetric both use keys\n",
    "    * Hashes do not use keys, they only use math functions\n",
    "        * Example: Very rudimentary, but concept is important – hashes are one way functions H E L   L    O           (every characters numeric value, or the message, then added together) 8 5 12 12 15 = 52                (this value is the message digest/hash)\n",
    "    * If you ONLY know the 52 (hash), trying to figure out the corresponding additive values would be arduous. Coupled with higher bit level encryption, the effort could take longer than we have time in the universe. However, if they both match, the message has not been modified.  Very easy one way math.\n",
    "\n",
    "\n",
    "* **Non-Repudiation**\n",
    "\n",
    "\n",
    "    * Sender encrypts hash with the sender’s Private key. Receiver decrypts hash with sender’s Public key.Receiver hashes document – if hashes match, receiver gets a guaranteed message has not been modified.     \n",
    "\n",
    "    * This is called a digital signature. A Hash encrypted with the senders Private Key\n",
    "    * Example: **Message Content**Hello Confidentiality (encrypt content with receivers Public key) **Message Content** 0LL34 **Hash** 52\n",
    "    * Integrity (the hash value before encryption)\n",
    "    * Non Repudiation (integrity + authenticity) -> (hash value after encryption with senders Private key) **Hash** 3ncryp7ed\n",
    "\n",
    "    * It is generally accepted that you cannot reverse a hash\n",
    "    * SSL – secure sockets layer – Asymmetrical (for all above), Symmetrical for data exchange (speed)\n",
    "\n",
    "# Section 3-2 Topic: Public Key Exchange\n",
    "\n",
    "* Learning Objectives: we continue our focus on Asymmetric Cryptography with a detailed diagram and discussion on secure public key exchange and how it works. You’ll learn the entire process from start to finish and why it’s a faster, more reliable encryption process.\n",
    "\n",
    "* You’ll also learn about Certificates of Authority (CA), what comprises the certificate revocation list (CRL), what a online certification status protocol (OCSP) is, and why they are each essential to the encryption process. We’ll discuss the entire PKI (public key infrastructure) and what role each of its components has.\n",
    "\n",
    "* And finally, we’ll observe then explore what CA hashing looks like during encryption and decryption at the browser level, and learn why thorough PKI knowledge and training in Symmetric & Asymmetric Encryption for netadmins and cyber security professionals is essential.\n",
    "\n",
    " * **SSL/TLS**\n",
    " \n",
    "    * Example:\n",
    "    * **[Desktop clients] -> uses https:// to reach -> [BankOfAmerica servers]**\n",
    "1. Client requests via https to server\n",
    "\n",
    "2. BankOfAmerica  sends **public key** to client key (In other words BankOfAmerica Sends a Certificate bind with their BOAPublicKey. That Certificate is singed by the CA’s Private Key Our Browsers come Pre-Installed with the CA’s Public Keys allowing US to decrypt the Certificate. Then we can Obtain BOA’s Public Key)\n",
    "3. Client generates a symmetric session key (i.e. 8439…)            \n",
    "    * how does it get this session key to server?\n",
    "\n",
    "4. Client encrypts the session key with servers public key (since server will be able to decode with private key) Result: Enables Asymmetric Key Exchange/Symmetric Data Exchange – Secure Channel Setup. This model still allows Man In The Middle (MITM) attacks, we must go further for assurance and authenticity.\n",
    "\n",
    "\n",
    "* **To cure this, we must have the following public key being verified by a CA via public key infrastructure**\n",
    "\n",
    "\n",
    "* BankOfAmerica server proves to Verisign CA (certificate of authority) that they are truly BankOfAamerica (other CA’s would be Thawte, Baltimore, Entrust, etc.) The CA then gives a certificate back to bind public/private key to server\n",
    "\n",
    "* **How do we know it came from Verisign, a trusted authority?**\n",
    "    * Verisign sends certificate encrypted  with  their Private key (can be decrypted with Verisigns public key).\n",
    "    * Your web browser may be pre-loaded with CA’s – trust gained by having CA’s public key.\n",
    "\n",
    "* **All this is possible using PKI Public Key Infrastructure**\n",
    "\n",
    "\n",
    "    * Could set up our own CA, where we ‘vouch’ for ourselves.  While that may not work for web based transactions, but for internal network transactions, it may be an acceptable trade-off.\n",
    "    * CRL (pronounced krill) – Certificate Revocation List\n",
    "    * OCSP – Online Certificate Status Protocol\n",
    "\n",
    "# Section 3-3 Topic: Advanced Encryption Package\n",
    "\n",
    "* Learning Objectives: The Advanced Encryption Package lab demonstrates use of an advanced encryption analysis components and how to use them to dig deeper in your file, password and data analysis.\n",
    "\n",
    "* You’ll observe creation of a password protected text file, see how the Advanced Encryption Package tool rates the strength of assigned password, and uses powerful algorithms to generate secure encryption for network files and directories.\n",
    "\n",
    "* In the Advanced Encryption Package lab, you’ll learn the advantages and disadvantages in the integrity principle vs. confidentiality principle and how those differences impact Symmetric vs. Asymmetric encryption. You’ll also see how to perform secure deletions, and learn how to use this tool as a key generator and PKI manager.\n",
    "\n",
    " * Advanced Encryption Package Lab, Can be found (Free Trial) at: http://www.aeppro.com/\n",
    "\n",
    "# Section 3-4 Topic: Hashing and Hash Collisions\n",
    "\n",
    "* Learning Objectives: This session of our Cryptography module introduces an extensive overview on Hashing. It begins with mapping out exactly what a Hash does and where it falls short and why it’s a disadvantage being one-directional.\n",
    "\n",
    "* You’ll also explore Hash collisions—what they are, how they happen, what it takes to recreate them, what happens when there is no integrity and how that is determined by the penetration tester.\n",
    "\n",
    "**Hashing**\n",
    "\n",
    "\n",
    "* Hash functions\n",
    "\n",
    "    * Scenario 1: A MITM could just intercept and change the hash!\n",
    "    * Without authenticity, hash is only useful for detecting accidental changes/corruption.\n",
    "\n",
    "    * Scenario 2: Digital Signature adds authentication to the integrity, we get true non repudiation:protects against accidental or intentional changes…this all requires a PKI ( overhead)\n",
    "\n",
    "    * Scenario 3: Introduce a solution; use a M(essage)A(uthentication)C(ode) = Message + Symmetric Key + Hashing Algorithm (this would be a step below having/paying for the PKI overhead)\n",
    "\n",
    "* **Passwords, credit cards, PII**\n",
    "* Digital Forensics\n",
    "    * Hash the drive before doing forensic analysis (write protect the drive).\n",
    "    * Even opening a file could change the hash.\n",
    "    \n",
    "    \n",
    "* **Malware analysis and virus detection**\n",
    "\n",
    "* Hash Collisions\n",
    "* Two different pieces of text product the same hash.  Collision resistant hashes are the goal. If a collision is achieved, you now can produce the hash even though it was not the original.\n",
    "* **MAC**\n",
    "\n",
    "* **HMAC**\n",
    "\n",
    "# Section 3-5 Topic: Hash Calc\n",
    "\n",
    "* Learning Objectives: The Hash Calc lab teaches you what  information is gained from using Hash Calculators to analyze files within a directory, or specifically targeted files. For example, the output of the Hash Calc tool includes the message digest about the target as well as all its relevant integrity algorithms.\n",
    "\n",
    "* The lab also discloses several integrity algorithms not output from the Hash Calc tool that provide a wider range of output datasets. Used in conjunction with the Hash My Files, and Advanced Encryption Package tool Hash Calc can be a very revealing “go-to” suite of resources for cryptographic analysis.\n",
    "\n",
    "* HashCalc  is a fast and easy-to-use calculator that allows to compute message digests, checksums and HMACs for files, as well as for text and hex strings. It offers a choice of 13 of the most popular hash and checksum algorithms for calculations. Can be found at: http://www.slavasoft.com/hashcalc/\n",
    "\n",
    "# Section 3-6 Topic: Digital Signature, SHA2(256) and RSA\n",
    "\n",
    "* Learning Objectives: In this sub-part of our previous Hash lesson, we take a closer, more intimate look at digital signatures, SHA2(256). We’ll look at Asymmetric Algorithm, RSA, what is met by satisfying the digital signature standard, and what the entire packet transfer looks like when hashing takes place.\n",
    "\n",
    "* We will also introduce concepts behind protecting data at rest.\n",
    "\n",
    "* Several key definitions are discussed included full disk encryption, file encryption, code signing with a discussion on how they differ, what occurs in each of those data transactions, and why that sequence of events is important for Penetration Testers to know as part of the Asymmetric encryption process.\n",
    "\n",
    "* **Digital Signatures**\n",
    "\n",
    "* **Hash (remember, hashes are just one way math)**\n",
    "\n",
    "\n",
    "* MD4, SHA-1, SHA-2\n",
    "\n",
    "\n",
    "* **Asymmetric Algorithm**\n",
    "\n",
    "\n",
    "* RSA – satisfied the Digital Signature Standard\n",
    "\n",
    "\n",
    "* **Protecting Data At Rest**\n",
    "\n",
    "    * File Encryption – some files or properties may be readable if hard drive is moved to another computer OS (i.e. Windows Hard Drive using Encrypting File System is physically moved to a Linux Box)\n",
    "    * Full Disk Encryption – modern motherboard have TPM (trusted platform module)\n",
    "    * BitLocker, PGP, etc. achieve this.\n",
    "    * Code Signing – distributed code accessed on Internet (Java, Javascript, ActiveX) should be digitally signed.\n",
    "\n",
    "# Section 3-7 Topic: Hash My Files\n",
    "\n",
    "Learning Objectives: This lab demonstrates the Hash My Files tool which analyzes files by specific file or by directory and validates their integrity. The Hash My Files process report is basic and the output can be exported to a series of different formats including HTML.\n",
    "\n",
    "You’ll also observe a demonstration of how the Hash My Files tool works and what you can learn from the information it provides.\n",
    "\n",
    "Because of their strong algorithms, security professionals rely heavily on hashing as a reliable Cryptographic analysis tool for integrity validation.\n",
    "\n",
    " Hash My Files tool analyzes files by specific file or by directory and validates their integrity.\n",
    "\n",
    "HashMyFiles is small utility that allows you to calculate the MD5 and SHA1 hashes of one or more files in your system. You can easily copy the MD5/SHA1 hashes list into the clipboard, or save them into text/html/xml file.\n",
    "\n",
    "HashMyFiles can also be launched from the context menu of Windows Explorer, and display the MD5/SHA1 hashes of the selected file or folder.\n",
    "\n",
    "\n",
    "Can be found at: http://www.nirsoft.net/\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python [default]",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  },
  "latex_envs": {
   "LaTeX_envs_menu_present": true,
   "bibliofile": "biblio.bib",
   "cite_by": "apalike",
   "current_citInitial": 1,
   "eqLabelWithNumbers": true,
   "eqNumInitial": 1,
   "labels_anchors": false,
   "latex_user_defs": false,
   "report_style_numbering": false,
   "user_envs_cfg": false
  },
  "toc": {
   "colors": {
    "hover_highlight": "#DAA520",
    "running_highlight": "#FF0000",
    "selected_highlight": "#FFD700"
   },
   "moveMenuLeft": true,
   "nav_menu": {
    "height": "423px",
    "width": "252px"
   },
   "navigate_menu": true,
   "number_sections": true,
   "sideBar": true,
   "threshold": 4,
   "toc_cell": true,
   "toc_section_display": "block",
   "toc_window_display": true
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}