Clean all URLs in clipboard
-
You never define "clean".
To strip excess URL parameters (i.e. beginning "&", almost certainly junk) if the clipboard buffer contains a URL and only a URL (Wayland only):
if url=$(printf '%s' "$(wl-paste --no-newline | awk '$1=$1' ORS=' ')" | egrep -o 'https?://[^ ]+') ; then wl-copy "${url%%\&*}" fiI think it really depends on the website and even where you are on the website. For example, if you're on YT, the
watch?v=<b64_id>is probably not something you want to throw away. If you're on a news site likeimaginarynews.com/.../the-article-title/?tracking-garbage=<...>then you probably do. -
It's never worked for me either. The ClearURLs addon has a function to copy a clean URL and that works great though. It's open source, so maybe someone could turn its cleaning function into a program that could be used for the clipboard.
Hmm. Thanks, though I'm seeking universal /offline so if I get URLs in other platforms, I won't have to turn to the browser to purge them of junk. Or maybe this could be converted into a standalone program...
-
Fair enough, I haven't given that too much thought myself until now. After playing around with Firefox's URL cleaning, I realized there are some parameters I want to keep. So, by clean I mean removing all unnecessary parameters in the URL.
For example,
https://youtu.be/jNQXAC9IVRw?si=someTrackingIdwould becomehttps://youtu.be/jNQXAC9IVRw, buthttps://www.youtube.com/watch?v=jNQXAC9IVRwkeeps it's parameter, because it is necessary.I guess replicating the logic for deciding which parameters to keep is not trivial, so the easiest solution is probably just manually pasting links into firefox, and just copying them cleanly from there. Thanks for providing some code, though!
There is no logic as to which parameters is useful and which is used for tracking. But there are databases.
Here is the one for the CleanURLs extension and here is the one for the AdGuard URL Tracking filter list (which I recommend everyone should enable in uBlock Origin).
-
There is no logic as to which parameters is useful and which is used for tracking. But there are databases.
Here is the one for the CleanURLs extension and here is the one for the AdGuard URL Tracking filter list (which I recommend everyone should enable in uBlock Origin).
Oh, nice! That's definitely valuable info. Personally, I do think it's too much work to implement that properly, though.
-
I think it really depends on the website and even where you are on the website. For example, if you're on YT, the
watch?v=<b64_id>is probably not something you want to throw away. If you're on a news site likeimaginarynews.com/.../the-article-title/?tracking-garbage=<...>then you probably do.Sure, but my script only gets rid of the second and later parameters, i.e. ones with
¬?. Personally I don't think I've ever seen a single site where an¶m is critical. These days there few where the?matters either, but yes YT is a holdout. -
That'd be cool. Whenever I'm sharing a YT link, I'm always a bit suspicious of what info the youtu.be URL is hiding, so I paste it into a browser to get a clean URL.
Maybe this is silly, but I'd be cool to do that automatically.
Well for youtube it's quite easy, there are only 4 useful parameters that I can think of, the video id
v, the playlist idlistandindexif it's a playlist and the timetif you're sending a specific time in the video. Everything else can be removed.
Here's what uBlock Origin with the AdGuard URL Tracking filter list:! Youtube $removeparam=embeds_referring_euri,domain=youtubekids.com|youtube-nocookie.com|youtube.com $removeparam=embeds_referring_origin,domain=youtubekids.com|youtube-nocookie.com|youtube.com $removeparam=source_ve_path,domain=youtubekids.com|youtube-nocookie.com|youtube.com ||youtube.com^$removeparam=pp -
Sure, but my script only gets rid of the second and later parameters, i.e. ones with
¬?. Personally I don't think I've ever seen a single site where an¶m is critical. These days there few where the?matters either, but yes YT is a holdout.There are plenty of sites that use more than one parameters. It's true that a lot of sites now use the history API instead of url parameters but you can still find plenty, and you have no garante about the parameters order.
Any site with a search page that have a few options will probably use url parameters instead of the history API. It's easier to parse and will end up being shorter most of the time. -
Oh, nice! That's definitely valuable info. Personally, I do think it's too much work to implement that properly, though.
There are some examples of projects that use CleanURLs db in its readme but most have not been updated for a long time.
-
There are plenty of sites that use more than one parameters. It's true that a lot of sites now use the history API instead of url parameters but you can still find plenty, and you have no garante about the parameters order.
Any site with a search page that have a few options will probably use url parameters instead of the history API. It's easier to parse and will end up being shorter most of the time.Search results, sure. Personally I have rarely if ever wanted to save or share such URLs. But sure.
-
I know firefox has the very useful "Copy clean Link" option in the context menu, but I would like a similar feature for copying links from any other software, like spotify for example. So I am looking for some software that hooks into the clipboard pipeline, and cleans any URL that gets added. I tried googling for something like it, but was completely unsuccessful. Does anyone have a clue how I might go about achieving this?
Thanks in advance
The problem is, how do you distinguish url parameters that are essential from url parameters thats used to track?
-
Query parameters are junk? They have tons of legitimate uses, they’re one of the better places to keep state.
As a WebDev... URL parameters are definitely not the place to keep state... Were not in the 00's anymore. They do have legit uses, but we have JS localStorage nowadays.
-
Alternatively you can configure a hotkey in the GNOME Settings, or the equivalent for other DEs, to execute a bash script or anything.
-
As a WebDev... URL parameters are definitely not the place to keep state... Were not in the 00's anymore. They do have legit uses, but we have JS localStorage nowadays.
They have pretty different use cases. Localstorage is for when you want persistence across page loads, not necessarily specific to any particular page but specific to a browser. An example would be storing user-selected light or dark mode.
Query parameters are specific to a page/URL and you get a lot of things for free when you use them:
- back/forward navigation
- bookmarking
- copy-paste to share
- page level caching
- access on both server and client
Query parameters are good for things like searches, filters, sorting, etc
-
They have pretty different use cases. Localstorage is for when you want persistence across page loads, not necessarily specific to any particular page but specific to a browser. An example would be storing user-selected light or dark mode.
Query parameters are specific to a page/URL and you get a lot of things for free when you use them:
- back/forward navigation
- bookmarking
- copy-paste to share
- page level caching
- access on both server and client
Query parameters are good for things like searches, filters, sorting, etc
I disagree. I definitely prefer REST APIs that use the file path for searches, filters, sorting. You get most if not all benefits from query parameters, and if done correctly it is just as clearly readable as query params.
-
I disagree. I definitely prefer REST APIs that use the file path for searches, filters, sorting. You get most if not all benefits from query parameters, and if done correctly it is just as clearly readable as query params.
But what if you have multiple optional parameters?
-
But what if you have multiple optional parameters?
have multiple routes point to the same endpoint, dynamically adding the parameters serverside
-
have multiple routes point to the same endpoint, dynamically adding the parameters serverside
That sounds harder than just using query parameters. What are the benefits?
-
That sounds harder than just using query parameters. What are the benefits?
Having more beautiful and structured URLs. I suppose for those cases it's more of a preference, and with the tooling I use (.NET) it's not too difficult to achieve.
I guess my gripe with your original statement was that I was thinking mostly of state like user login etc. I have to concede it's not totally garbage for the cases you mentioned.
-
I know firefox has the very useful "Copy clean Link" option in the context menu, but I would like a similar feature for copying links from any other software, like spotify for example. So I am looking for some software that hooks into the clipboard pipeline, and cleans any URL that gets added. I tried googling for something like it, but was completely unsuccessful. Does anyone have a clue how I might go about achieving this?
Thanks in advance
Looks like https://old.reddit.com/r/kde/comments/d3m0fz/how_to_open_links_in_mpv_with_klipper/ is a good starting point, i.e
- Open menu in system tray.
- Right click on Clipboard => Configure Clipboard.
- Go to Actions Configuration => Add Action.
then... to try!
I'm just discovering this too but seems like the right way.That said I'd be cautious and limit the use case to only what you have, e.g. Spotify links, at least at first because I imagine one can get into hairy edge cases quickly.
Keep us posted!
-
System shared this topic on
