Login/Register
Send a POST request using httr R package
Asked Answered
Solved rhttppostauthenticationhttr
T

1

21

I can't figure out how to imitate what the browser does, when sending the server data via a POST request. Here are the relevant URLs with explanation below.

(1) http://kenpom.com/

(2) http://kenpom.com/register.php?frompage=1
<form id="login" method="POST" action="handlers/login_handler.php">
<label>E-mail </label><input type="text" name="email" />
<label>Password </label><input type="password" name="password" />
<input type="submit" name="submit" value="Login!" />

(3) http://kenpom.com/team.php?team=Rice

(1) home page (select team page when NOT logged in, re-direct -> (2) )

(2) login page (re-direct to team specific page upon successful login)

(3) team specific page: e.g. Rice

url <- ("http://kenpom.com/team.php?team=Rice")

login <- list(
        email = "login",
        password = "password"
)

teampage <- POST(url, body = login)

Response [http://kenpom.com/register.php?frompage=1]
  Date: 2015-03-07 23:04
  Status: 200
  Content-Type: text/html
  Size: 7.45 kB
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd">
<HTML>
<HEAD>
<LINK REL=stylesheet TYPE="text/css" HREF="css/rate.css?1414365416">
<TITLE>kenpom.com subscription</TITLE>

Ultimately want to scrape some info using the rvest package but end up with empty results as it attempts to scrape: http://kenpom.com/register.php?frompage=1

Trepidation answered 8/3, 2015 at 9:9 Comment(0)
D
34

Try

library(httr)
login <- list(
  email = "login",
  password = "password",
  submit = "Login!"
)
res <- POST("http://kenpom.com/handlers/login_handler.php", body = login, encode = "form", verbose())
team <- GET("http://kenpom.com/team.php?team=Rice", verbose())
Depurative answered 8/3, 2015 at 12:41 Comment(1)
A coma is missing in the list (sorry I can't edit, just adding a coma is to short, 6 characters are required) – Attitude

© 2022 - 2024 — McMap. All rights reserved.