Skip to content
Snippets Groups Projects
Commit c99c65b5 authored by gsingh58's avatar gsingh58
Browse files

lec13 updated

parent df587723
No related branches found
No related tags found
No related merge requests found
Pipeline #795928 passed
Stage: test
Hide whitespace changes
Inline Side-by-side
lecture_material/13-web-3/solution.ipynb
+ 174
− 3
View file @ c99c65b5
%% Cell type:markdown id:cf313adf tags:
# Web 3: More Flask
# Web 3: More Flask and A/B testing
%% Cell type:code id:d55e4bb4-9f29-4f4f-bba6-05054718259b tags:
``` python
import requests
import time
import urllib.robotparser
import pandas as pd
# new import statement: requires pip3 install scipy
from scipy import stats
```
%% Cell type:markdown id:725234ef-a02b-47da-bfec-aaa16e852a58 tags:
- `flask.request.args`: enables us to get the arguments passed as part of the URL
- How do we pass arguments?
- at the end of the URL, add a "?"
- then separate argument-value pair by "="
- use "&" as delimiter between two argument-value pairs
- examples:
- http://34.123.132.20:5000/add?x=10&y=20
- http://34.123.132.20:5000/survey?major=CS
- http://34.123.132.20:5000/survey?major=Mechanical_Engineering
%% Cell type:code id:8241e51c tags:
``` python
base_url = "http://34.123.132.20:5000/"
```
%% Cell type:markdown id:23ba100b tags:
### `urllib.robotparser`
- Documentation: https://docs.python.org/3/library/urllib.robotparser.html
%% Cell type:code id:379c3ae5-7344-45b1-88c3-b35f0bd8eb5b tags:
``` python
rp = urllib.robotparser.RobotFileParser()
rp.set_url(base_url + "/robots.txt")
rp.read()
rp.can_fetch("cs320bot", base_url + "/slow")
```
%% Output
True
%% Cell type:code id:2e3fb01c-4281-4cbf-8828-98e04d27d09a tags:
``` python
rp.can_fetch("cs320bot", base_url + "never")
```
%% Output
False
True
%% Cell type:code id:6cc81b85 tags:
``` python
def friendly_get(url):
if not rp.can_fetch("cs320bot", url):
raise Exception("you're not supposed to visit that page")
while True:
resp = requests.get(url)
if resp.status_code == 429:
seconds = int(resp.headers.get("Retry-After", 1))
print(f"sleep {seconds}")
time.sleep(seconds)
continue
resp.raise_for_status() # raise exception if not 200
return resp
friendly_get(base_url + "slow").text
```
%% Output
'welcome!'
%% Cell type:markdown id:1dbd2fad-1bf5-437f-9ebb-6694ba860e27 tags:
# A/B testing
%% Cell type:code id:6922661b-af1b-41d5-bcb0-f2759e890f3e tags:
``` python
df = pd.DataFrame({
"click": {"A": 50, "B": 55},
"no-click": {"A": 50, "B": 45}
})
df
# Which has the higher CTR A or B?
```
%% Output
click no-click
A 50 50
B 55 45
%% Cell type:code id:31b0de1b-f7fb-42ee-a087-3d884cc31590 tags:
``` python
_, pvalue = stats.fisher_exact(df)
pvalue
# no evidence that A and B are difference because pvalue is not less than 5%
```
%% Output
0.5712421394829712
%% Cell type:markdown id:5dde0ee6-b03e-4bbf-b896-1794a2bff610 tags:
### Two situations when pvalue will be lower than significance threshold
1. Sample size is the same, but skew is very heavy --- unlikely to have that by chance
2. Sample size is large, but skew is small
%% Cell type:code id:b8719b9e-f366-47a0-9d96-50b4fdd8fb27 tags:
``` python
# Scenario 1:
# Sample size is the same, but skew is very heavy ---
# unlikely to have that by chance
df = pd.DataFrame({
"click": {"A": 50, "B": 75},
"no-click": {"A": 50, "B": 25}
})
_, pvalue = stats.fisher_exact(df)
pvalue
```
%% Output
0.00042033045869994034
%% Cell type:code id:72a18c43-0f07-4e7f-bb88-89a43563f295 tags:
``` python
# Scenario 2:
# Sample size is large, but skew is small
df = pd.DataFrame({
"click": {"A": 500, "B": 550},
"no-click": {"A": 500, "B": 450}
})
_, pvalue = stats.fisher_exact(df)
pvalue
```
%% Output
0.02820356890423392
......
lecture_material/13-web-3/template_lec_001.ipynb
+ 90
− 3
View file @ c99c65b5
%% Cell type:markdown id:cf313adf tags:
# Web 3: More Flask
# Web 3: More Flask and A/B testing
%% Cell type:code id:d55e4bb4-9f29-4f4f-bba6-05054718259b tags:
``` python
import requests
import time
import pandas as pd
# new import statement: requires pip3 install scipy
from scipy import stats
```
%% Cell type:markdown id:a5f26f67-000a-4d68-8033-3e46023b8196 tags:
- `flask.request.args`: enables us to get the arguments passed as part of the URL
- How do we pass arguments?
- at the end of the URL, add a "?"
- then separate argument-value pair by "="
- use "&" as delimiter between two argument-value pairs
- examples:
- http://34.123.132.20:5000/add?x=10&y=20
- http://34.123.132.20:5000/survey?major=CS
- http://34.123.132.20:5000/survey?major=Mechanical_Engineering
%% Cell type:code id:8241e51c tags:
``` python
base_url = "http://34.123.132.20:5000/"
```
%% Cell type:markdown id:23ba100b tags:
### `urllib.robotparser`
- Documentation: https://docs.python.org/3/library/urllib.robotparser.html
%% Cell type:code id:379c3ae5-7344-45b1-88c3-b35f0bd8eb5b tags:
``` python
```
%% Cell type:code id:2e3fb01c-4281-4cbf-8828-98e04d27d09a tags:
``` python
```
%% Cell type:code id:6cc81b85 tags:
%% Cell type:code id:0eb41e31-490e-419b-af15-db66e0dd6fd1 tags:
``` python
def friendly_get(url):
while True:
resp = requests.get(url)
if resp.status_code == 429:
seconds = int(resp.headers.get("Retry-After", 1))
print(f"sleep {seconds}")
time.sleep(seconds)
continue
resp.raise_for_status() # raise exception if not 200
return resp
friendly_get(base_url + "slow").text
```
%% Cell type:markdown id:fcfa857a-10e7-4e74-adcc-9c4d384e9986 tags:
# A/B testing
%% Cell type:code id:d4839880-5642-49ce-b1cf-938ddf409229 tags:
``` python
df = pd.DataFrame({
"click": {"A": 50, "B": 55},
"no-click": {"A": 50, "B": 45}
})
df
# Which has the higher CTR A or B?
```
%% Cell type:code id:341e9430-d7c2-4cba-a2f1-b5fb95a1efa6 tags:
``` python
_, pvalue = stats.fisher_exact(df)
pvalue
# no evidence that A and B are difference because pvalue is not less than 5%
```
%% Cell type:markdown id:3fa3b996-ef70-4492-8221-dbe597af8541 tags:
### Two situations when pvalue will be lower than significance threshold
1. Sample size is the same, but skew is very heavy --- unlikely to have that by chance
2. Sample size is large, but skew is small
%% Cell type:code id:245ac3cf-a7b4-4bd4-81d8-caf7fc4897fe tags:
``` python
# Scenario 1:
# Sample size is the same, but skew is very heavy ---
# unlikely to have that by chance
df = pd.DataFrame({
"click": {"A": 50, "B": 75},
"no-click": {"A": 50, "B": 25}
})
_, pvalue = stats.fisher_exact(df)
pvalue
```
%% Cell type:code id:e3a1b056-3315-494d-9667-3bfa5ebfa863 tags:
``` python
# Scenario 2:
# Sample size is large, but skew is small
df = pd.DataFrame({
"click": {"A": 500, "B": 550},
"no-click": {"A": 500, "B": 450}
})
_, pvalue = stats.fisher_exact(df)
pvalue
```
......
lecture_material/13-web-3/template_lec_002.ipynb
+ 89
− 2
View file @ c99c65b5
%% Cell type:markdown id:cf313adf tags:
# Web 3: More Flask
# Web 3: More Flask and A/B testing
%% Cell type:code id:d55e4bb4-9f29-4f4f-bba6-05054718259b tags:
``` python
import requests
import time
import pandas as pd
# new import statement: requires pip3 install scipy
from scipy import stats
```
%% Cell type:markdown id:14525019-f30b-40a7-be53-db49868abce6 tags:
- `flask.request.args`: enables us to get the arguments passed as part of the URL
- How do we pass arguments?
- at the end of the URL, add a "?"
- then separate argument-value pair by "="
- use "&" as delimiter between two argument-value pairs
- examples:
- http://34.123.132.20:5000/add?x=10&y=20
- http://34.123.132.20:5000/survey?major=CS
- http://34.123.132.20:5000/survey?major=Mechanical_Engineering
%% Cell type:markdown id:527600aa tags:
### Rate-limited webpage parsing
- `requests` module:
- `resp = requests.get(<URL>)` method: enables us to send HTTP GET request
- `resp.status_code`: status code of the response
- `resp.text`: `str` text content of the response
- `resp.headers`: `dict` content of response headers
%% Cell type:code id:8241e51c tags:
``` python
base_url = "http://34.123.132.20:5000/"
```
%% Cell type:markdown id:23ba100b tags:
### `urllib.robotparser`
- Documentation: https://docs.python.org/3/library/urllib.robotparser.html
%% Cell type:code id:379c3ae5-7344-45b1-88c3-b35f0bd8eb5b tags:
``` python
```
%% Cell type:code id:2e3fb01c-4281-4cbf-8828-98e04d27d09a tags:
``` python
```
%% Cell type:code id:6cc81b85 tags:
``` python
def friendly_get(url):
while True:
resp = requests.get(url)
if resp.status_code == 429:
seconds = int(resp.headers.get("Retry-After", 1))
print(f"sleep {seconds}")
time.sleep(seconds)
continue
resp.raise_for_status() # raise exception if not 200
return resp
friendly_get(base_url + "slow").text
```
%% Cell type:markdown id:b2353748-f9a6-4de1-80f0-d5a398df5783 tags:
# A/B testing
%% Cell type:code id:bcc93502-38f4-4e4a-b7b4-e4c868492aa3 tags:
``` python
df = pd.DataFrame({
"click": {"A": 50, "B": 55},
"no-click": {"A": 50, "B": 45}
})
df
# Which has the higher CTR A or B?
```
%% Cell type:code id:30438fd0-88fd-4f81-b2b7-dcb96679a489 tags:
``` python
_, pvalue = stats.fisher_exact(df)
pvalue
# no evidence that A and B are difference because pvalue is not less than 5%
```
%% Cell type:markdown id:204bb86d-4504-4a15-88d0-9c6b8189c23c tags:
### Two situations when pvalue will be lower than significance threshold
1. Sample size is the same, but skew is very heavy --- unlikely to have that by chance
2. Sample size is large, but skew is small
%% Cell type:code id:74484f80-8dd4-4035-a329-157e1389084b tags:
``` python
# Scenario 1:
# Sample size is the same, but skew is very heavy ---
# unlikely to have that by chance
df = pd.DataFrame({
"click": {"A": 50, "B": 75},
"no-click": {"A": 50, "B": 25}
})
_, pvalue = stats.fisher_exact(df)
pvalue
```
%% Cell type:code id:938738ca-2db3-4408-b4e4-2571b89084ee tags:
``` python
# Scenario 2:
# Sample size is large, but skew is small
df = pd.DataFrame({
"click": {"A": 500, "B": 550},
"no-click": {"A": 500, "B": 450}
})
_, pvalue = stats.fisher_exact(df)
pvalue
```
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment