-
Notifications
You must be signed in to change notification settings - Fork 12
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Adds initial V1 downloader for Cloudflare Stream - Supports HLS manifests for TS segments and fragemented MP4s - Adds TUS upload support for direct file uploads
- Loading branch information
Ryan Schachte
committed
Jul 29, 2023
0 parents
commit 4f5ec55
Showing
8 changed files
with
870 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,2 @@ | ||
| *[a-fA-F0-9]{32}*/* | ||
| *[a-fA-F0-9]{32}*/ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,92 @@ | ||
| # Cloudflare Stream Video Downloader | ||
|
|
||
| Utility to download MP4 videos and individual [MPEG-TS](https://en.wikipedia.org/wiki/MPEG_transport_stream) segments for varying resolutions off a [Cloudflare Stream](https://developers.cloudflare.com/stream/) HLS manifest URL. | ||
|
|
||
| ## Supports | ||
| - ✅ Download video and segments | ||
| - ✅ List available resolutions & manifests | ||
| - ✅ Upload support | ||
| - ✅ Count number of segments | ||
|
|
||
| ## Installation | ||
| ``` | ||
| go install github.com/Schachte/cloudflare-stream-downloader@master | ||
| ``` | ||
|
|
||
| ### Troubleshooting | ||
|
|
||
| - Make sure you have Go installed on your system - [download here](https://go.dev/doc/install) | ||
| - Make sure you `GOPATH` and `GOBIN` values are set correctly | ||
|
|
||
| Example: | ||
| ``` | ||
| GOPATH=$HOME/Documents/go | ||
| GOBIN=$GOPATH/bin | ||
| PATH=$PATH:$GOBIN | ||
| go install github.com/Schachte/cloudflare-stream-downloader@master | ||
| cloudflare-stream-downloader <HLS MANIFEST URL> | ||
| ``` | ||
|
|
||
| ## Usage | ||
| ```sh | ||
| cloudflare-stream-downloader <HLS_MANIFEST_URL> | ||
| ``` | ||
|
|
||
| For building the binary, see section below on `Builds & Releases` or [download latest release here.](https://github.com/Schachte/cloudflare-stream-downloader/releases) | ||
|
|
||
| You can grab the HLS manifest from the Cloudflare Dash as shown in the image below: | ||
|
|
||
|  | ||
|
|
||
| ## Example Output | ||
| ``` | ||
| cloudflare-stream-downloader https://.../manifest/video.m3u8 | ||
| Use the arrow keys to navigate: ↓ ↑ → ← | ||
| ? Cloudflare Stream Downloader:: | ||
| ▸ Download video and segments | ||
| List available resolutions | ||
| Count number of segments | ||
| 🚫 Exit | ||
| ✔ Download video and segments | ||
| 📋 Listing all available resolutions for video UID: f92743594bb2d9471c8ef80b9437c1ff | ||
| 0) 766x360 | ||
| 1) 510x240 | ||
| 2) 🚫 Exit | ||
| 📼 Select resolution: 0 | ||
| 🌱 Beginning download for [766x360] | ||
| 10% complete | ||
| 20% complete | ||
| 30% complete | ||
| 40% complete | ||
| 50% complete | ||
| 60% complete | ||
| 70% complete | ||
| 80% complete | ||
| 90% complete | ||
| Complete! | ||
| --------------------------------------------- | ||
| Video output: | ||
| ./f92743594bb2d9471c8ef80b9437c1ff/766x360/f92743594bb2d9471c8ef80b9437c1ff.mp4 | ||
| Segments output: | ||
| ./f92743594bb2d9471c8ef80b9437c1ff/766x360/segments/ | ||
| Playback: | ||
| ffplay ./f92743594bb2d9471c8ef80b9437c1ff/766x360/f92743594bb2d9471c8ef80b9437c1ff.mp4 | ||
| --------------------------------------------- | ||
| ``` | ||
|
|
||
| ## Builds & Releases | ||
|
|
||
| ### Releases | ||
|
|
||
| [Download latest release here.](https://github.com/Schachte/cloudflare-stream-downloader/releases) | ||
|
|
||
| or | ||
|
|
||
| You can also run the latest builds for all operating systems by running: `make all`. |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,18 @@ | ||
| module github.com/Schachte/cloudflare-stream-downloader | ||
|
|
||
| go 1.19 | ||
|
|
||
| require ( | ||
| github.com/grafov/m3u8 v0.12.0 | ||
| github.com/manifoldco/promptui v0.9.0 | ||
| github.com/schollz/progressbar/v3 v3.13.1 | ||
| ) | ||
|
|
||
| require ( | ||
| github.com/chzyer/readline v0.0.0-20180603132655-2972be24d48e // indirect | ||
| github.com/mattn/go-runewidth v0.0.14 // indirect | ||
| github.com/mitchellh/colorstring v0.0.0-20190213212951-d06e56a500db // indirect | ||
| github.com/rivo/uniseg v0.2.0 // indirect | ||
| golang.org/x/sys v0.6.0 // indirect | ||
| golang.org/x/term v0.6.0 // indirect | ||
| ) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,34 @@ | ||
| github.com/chzyer/logex v1.1.10 h1:Swpa1K6QvQznwJRcfTfQJmTE72DqScAa40E+fbHEXEE= | ||
| github.com/chzyer/logex v1.1.10/go.mod h1:+Ywpsq7O8HXn0nuIou7OrIPyXbp3wmkHB+jjWRnGsAI= | ||
| github.com/chzyer/readline v0.0.0-20180603132655-2972be24d48e h1:fY5BOSpyZCqRo5OhCuC+XN+r/bBCmeuuJtjz+bCNIf8= | ||
| github.com/chzyer/readline v0.0.0-20180603132655-2972be24d48e/go.mod h1:nSuG5e5PlCu98SY8svDHJxuZscDgtXS6KTTbou5AhLI= | ||
| github.com/chzyer/test v0.0.0-20180213035817-a1ea475d72b1 h1:q763qf9huN11kDQavWsoZXJNW3xEE4JJyHa5Q25/sd8= | ||
| github.com/chzyer/test v0.0.0-20180213035817-a1ea475d72b1/go.mod h1:Q3SI9o4m/ZMnBNeIyt5eFwwo7qiLfzFZmjNmxjkiQlU= | ||
| github.com/davecgh/go-spew v1.1.0/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= | ||
| github.com/davecgh/go-spew v1.1.1 h1:vj9j/u1bqnvCEfJOwUhtlOARqs3+rkHYY13jYWTU97c= | ||
| github.com/davecgh/go-spew v1.1.1/go.mod h1:J7Y8YcW2NihsgmVo/mv3lAwl/skON4iLHjSsI+c5H38= | ||
| github.com/grafov/m3u8 v0.12.0 h1:T6iTwTsSEtMcwkayef+FJO8kj+Sglr4Lh81Zj8Ked/4= | ||
| github.com/grafov/m3u8 v0.12.0/go.mod h1:nqzOkfBiZJENr52zTVd/Dcl03yzphIMbJqkXGu+u080= | ||
| github.com/k0kubun/go-ansi v0.0.0-20180517002512-3bf9e2903213/go.mod h1:vNUNkEQ1e29fT/6vq2aBdFsgNPmy8qMdSay1npru+Sw= | ||
| github.com/manifoldco/promptui v0.9.0 h1:3V4HzJk1TtXW1MTZMP7mdlwbBpIinw3HztaIlYthEiA= | ||
| github.com/manifoldco/promptui v0.9.0/go.mod h1:ka04sppxSGFAtxX0qhlYQjISsg9mR4GWtQEhdbn6Pgg= | ||
| github.com/mattn/go-isatty v0.0.17/go.mod h1:kYGgaQfpe5nmfYZH+SKPsOc2e4SrIfOl2e/yFXSvRLM= | ||
| github.com/mattn/go-runewidth v0.0.14 h1:+xnbZSEeDbOIg5/mE6JF0w6n9duR1l3/WmbinWVwUuU= | ||
| github.com/mattn/go-runewidth v0.0.14/go.mod h1:Jdepj2loyihRzMpdS35Xk/zdY8IAYHsh153qUoGf23w= | ||
| github.com/mitchellh/colorstring v0.0.0-20190213212951-d06e56a500db h1:62I3jR2EmQ4l5rM/4FEfDWcRD+abF5XlKShorW5LRoQ= | ||
| github.com/mitchellh/colorstring v0.0.0-20190213212951-d06e56a500db/go.mod h1:l0dey0ia/Uv7NcFFVbCLtqEBQbrT4OCwCSKTEv6enCw= | ||
| github.com/pmezard/go-difflib v1.0.0 h1:4DBwDE0NGyQoBHbLQYPwSUPoCMWR5BEzIk/f1lZbAQM= | ||
| github.com/pmezard/go-difflib v1.0.0/go.mod h1:iKH77koFhYxTK1pcRnkKkqfTogsbg7gZNVY4sRDYZ/4= | ||
| github.com/rivo/uniseg v0.2.0 h1:S1pD9weZBuJdFmowNwbpi7BJ8TNftyUImj/0WQi72jY= | ||
| github.com/rivo/uniseg v0.2.0/go.mod h1:J6wj4VEh+S6ZtnVlnTBMWIodfgj8LQOQFoIToxlJtxc= | ||
| github.com/schollz/progressbar/v3 v3.13.1 h1:o8rySDYiQ59Mwzy2FELeHY5ZARXZTVJC7iHD6PEFUiE= | ||
| github.com/schollz/progressbar/v3 v3.13.1/go.mod h1:xvrbki8kfT1fzWzBT/UZd9L6GA+jdL7HAgq2RFnO6fQ= | ||
| github.com/stretchr/objx v0.1.0/go.mod h1:HFkY916IF+rwdDfMAkV7OtwuqBVzrE8GR6GFx+wExME= | ||
| github.com/stretchr/testify v1.3.0 h1:TivCn/peBQ7UY8ooIcPgZFpTNSz0Q2U6UrFlUfqbe0Q= | ||
| github.com/stretchr/testify v1.3.0/go.mod h1:M5WIy9Dh21IEIfnGCwXGc5bZfKNJtfHm1UVUgZn+9EI= | ||
| golang.org/x/sys v0.0.0-20181122145206-62eef0e2fa9b/go.mod h1:STP8DvDyc/dI5b8T5hshtkjS+E42TnysNCUPdjciGhY= | ||
| golang.org/x/sys v0.0.0-20220811171246-fbc7d0a398ab/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= | ||
| golang.org/x/sys v0.6.0 h1:MVltZSvRTcU2ljQOhs94SXPftV6DCNnZViHeQps87pQ= | ||
| golang.org/x/sys v0.6.0/go.mod h1:oPkhp1MJrh7nUepCBck5+mAzfO9JrbApNNgaTdGDITg= | ||
| golang.org/x/term v0.6.0 h1:clScbb1cHjoCkyRbWwBEUZ5H/tIFu5TAXIqaZD0Gcjw= | ||
| golang.org/x/term v0.6.0/go.mod h1:m6U89DPEgQRMq3DNkDClhWw02AUbt2daBVO4cn4Hv9U= |
Oops, something went wrong.