/pipelinescrapes#
This endpoint provides daily updates on various aspects of pipeline activity, focusing on gas production. It offers detailed information about pipeline production in various regions, with a focus on specific locations and pipeline entities.
This endpoint is particularly useful for tracking energy production, monitoring pipeline activities, and analyzing regional energy trends.
Warning
A throttling mechanism with a rate limit of 300 requests per minute has been implemented for this endpoint. This is temporary and may be adjusted in the future.
Endpoint#
POST |
https://hyperion.api.synmax.com/v3/pipelinescrapes |
Usage#
Python#
- pipeline_scrapes(category=[None], county=[None], end_date=None, rec_del=[None], region=[None], start_date=None, state_code=[None], sub_region=[None])#
Returns daily pipeline scrapes.
Object returned is a pandas DataFrame.
⮞ Setup the client.
from synmax.hyperion import HyperionApiClient, ApiPayload
access_token = 'your access token goes here'
client = HyperionApiClient(access_token=access_token)
For a more detailed guide on setting up the Hyperion client, please see the Quickstart page.
⮞ Use parameters to narrow down your request.
payload = ApiPayload(start_date='2021-05-01', end_date='2022-06-25', sub_region=['S LA', 'West - TX'])
Tip
Narrow down your request to receive a faster response. Using no parameters will fetch the entire dataset which may take a very long time.
⮞ Call the function.
result_df = client.pipeline_scrapes(payload)
⮞ Print the results or save them for later.
# Print the entire response as a string.
print(result_df.to_string())
# Create a CSV file from the output.
result_df.to_csv('output.csv')
# Print the number of items per column.
print(result_df.count())
For more information on outputting to different formats, please see the pandas DataFrame documentation.
Parameters#
Query#
Parameter |
Type |
Description |
Example |
---|---|---|---|
category |
string array |
Limit search to a type of flow point as described by the pipelines informational posting location data disclosure. |
|
county |
string array |
Limit search by a list of counties. |
|
end_date |
string |
Limit search to an end date. Date formatting - [“YYYY-MM-DD”] |
|
rec_del |
integer array |
Limit search by Receipt or Delivery Point. |
|
region |
string array |
Limit search by a list of regions (clusters of multiple major producing basins). |
|
start_date |
string |
Limit search to a start date. Date formatting - [“YYYY-MM-DD”] |
|
state_code |
string array |
Limit search by a list of state codes. |
|
sub_region |
string array |
Limit search by a list of subregions (clusters of several counties forming a major producing basin). |
|
Response#
Parameter |
Type |
Description |
Example |
---|---|---|---|
category |
string |
Limit search to a type of flow point as described by the pipelines informational posting location data disclosure. |
“Production” |
county |
string |
County in the state where the well is located. |
“BEAUREGARD” |
date |
string |
Date of observation. Date formatting - [“YYYY-MM-DD”] |
“2022-06-01” |
gas_daily |
float |
Average rate of gas production expressed per day (in BCF/day). |
23.842 |
id |
integer |
A SynMax assigned unique ID for each flow point. |
1 |
location_name |
string |
Name of the flow point as provided by the pipeline’s information posting disclosure. |
“TIOGA” |
pipeline_name |
string |
Name of pipeline as provided by FERC. |
“Alliance Pipeline L.P.” |
rec_del |
integer |
Represents Receipt or Delivery Point. |
1 |
region |
string |
Aggregation of multiple major producing basins. |
“GULF” |
source |
string |
Indicates the origin or method of data collection for the pipeline information provided by the API. Returned values are either “scrape” for webscraped values, “ffill” for forward filled values. |
“scrape” |
state_ab |
string |
Abbreviation of the state. |
“LA” |
sub_region |
string |
Aggregation of several counties, typically representing a major producing basin. |
“S LA” |
Responses#
Normal Output#
category |
county |
date |
gas_daily |
id |
location_name |
pipeline_name |
rec_del |
region |
source |
state_ab |
sub_region |
---|---|---|---|---|---|---|---|---|---|---|---|
Production |
WILLIAMS (ND) |
01-05-2023 |
91253 |
1 |
TIOGA |
Alliance Pipeline L.P. |
1 |
midwest |
scrape |
ND |
North Dakota |
Production |
DEWEY (OK) |
01-06-2022 |
0 |
2 |
ANR/GPM INT-HAMMER RAY |
ANR Pipeline Company |
1 |
midwest |
scrape |
OK |
OK |
Production |
ST. LANDRY (LA) |
01-07-2022 |
0 |
5 |
OLIVER BENOIT 1 WELLS |
ANR Pipeline Company |
1 |
gulf |
scrape |
LA |
S LA |
Production |
ROBERTS (TX) |
01-01-2023 |
0 |
6 |
ROBERTS EAGLE ROCK |
ANR Pipeline Company |
1 |
gulf |
scrape |
TX |
North - TX |
Production |
HARPER (OK) |
01-06-2022 |
0 |
10 |
SEMINOLE-LOVEDALE |
ANR Pipeline Company |
1 |
midwest |
scrape |
OK |
OK |
Production |
HANSFORD (TX) |
01-01-2023 |
0 |
13 |
SHERMAN PLANT |
ANR Pipeline Company |
1 |
gulf |
scrape |
TX |
North - TX |
Production |
JEFFERSON DAVIS (LA) |
01-07-2022 |
2600 |
14 |
WEST LAKE ARTHUR |
ANR Pipeline Company |
1 |
gulf |
scrape |
LA |
S LA |
Production |
WELD (CO) |
22-06-2023 |
35474 |
19 |
SUMMIDJO/CPG (MKN) MAKENA REC WELD |
CHEYENNE PLAINS GAS PIPELINE |
1 |
west |
scrape |
CO |
Colorado wo SJ |
Production |
BEAVER (OK) |
23-09-2023 |
20 |
Baldwin 1 |
Cimarron River Pipeline LLC |
1 |
midwest |
ffill |
OK |
OK |
Note
Output data will return as “null” when input data is invalid or does not exist.