Mikrotik: Regex URL Block - Revision history

Onnowpurbo at 12:39, 22 April 2020

2020-04-22T12:39:19Z

Onnowpurbo at 12:38, 22 April 2020

2020-04-22T12:38:02Z

Onnowpurbo at 12:33, 22 April 2020

2020-04-22T12:33:38Z

Onnowpurbo at 12:25, 22 April 2020

2020-04-22T12:25:01Z

Onnowpurbo at 12:13, 22 April 2020

2020-04-22T12:13:03Z

Onnowpurbo at 11:44, 22 April 2020

2020-04-22T11:44:02Z

Onnowpurbo at 09:35, 22 April 2020

2020-04-22T09:35:23Z

Onnowpurbo: Created page with "Sumber: https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs Using Regex to Block URLs This tutorial explains how 1Blocker helps block URLs..."

2020-04-22T09:34:41Z

Created page with "Sumber: https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs Using Regex to Block URLs This tutorial explains how 1Blocker helps block URLs..."

New page

Sumber: https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs

Using Regex to Block URLs

This tutorial explains how 1Blocker helps block URLs both efficiently and flexibly. The article is worth reading if you want to dive into one of the most powerful features of 1Blocker.

However, if you find this material a little bit difficult, you can start right from the beginning: Block Sites - we've prepared several articles that give a brief overview of how to create basic custom rules in the Basic Tips section.

Important: the following rule format is valid only for the 'Block URL' type of rules available in the Advanced Customization section.

While blocking URLs, 1Blocker takes advantage of regular expression patterns or regex. A regular expression represents a sequence of characters written in a special format. Regex patterns are widely used, as they help engines extract information from any text by searching for one or more matches of a specific pattern. In our case, the engine is called WebKit's content blocker - the Safari's engine that processes the rules, and the patterns are represented by any URLs which we want to block.

Let’s now see how they work.

In regex, every character is “encoded” and validated symbol by symbol from left to right. We can divide regex characters into two groups:

ordinary characters like letters, digits, and some symbols. When Safari's engine meets an ordinary character, it perceives such a character as it is, without changing its function. For example, a regex “blocker” is the most basic pattern, simply matching the literal word “blocker”.
special characters, this is where the great power of regex lies. Some regex characters make the engine act in a special way, and they make the searching possibilities more flexible. For example, a dot . matches any character, so that three dots … may mean: dog, cat, run, one, etc. The following characters are special:
. - a dot
[] - square brackets
() - parentheses
? - a question mark
* - an asterisk
+ - a plus
^ - a caret

Also, there is an important rule you should remember about special characters. If a URL contains one of them, such a symbol must be escaped with a backslash \.

For example, let’s try to block the following URL: https://domain.com

There is a dot before “com”, right? So the engine will think that there is a character before the “com” part and it might be any symbol, not just a dot. For example, it will match https://domain#com too, which is not what we want. So, we need to put a backslash before the dot to match it literally: https://domain\.com, so that WebKit will clearly see that it is literally the dot before the “com” part.
Special Characters

If the main idea of regular expressions is a bit clearer now, let’s take a closer look at every special character supported by our engine. Important: these features apply only while creating rules in the Expert editor (available on Premium, learn more: Going Premium).

. (dot) can match any single character (letter, digit, whitespace, anything). If you actually need a dot in a URL, don’t forget to escape it with \.

For instance, https://1bl.cker\.com will block not only https://1blocker.com, but also https://1blucker.com, https://1bl1cker.com, etc.

[a-c], [abc] or any set of characters inside [square brackets] will only match any combinations of given characters [abc] or a sequential range of characters [a-c] and nothing else. In other words, the rule will be triggered only if any of the characters given in square brackets are found in the corresponding place in the URL.

A couple of examples: the pattern https://1blocker\.[kc]om corresponds either to https://1blocker.сom or https://1blocker.kom.

And speaking of ranges of characters, https://[1-3]blocker\.com will match three websites, https://1blocker.com, https://2blocker.com, and https://3blocker.com.

+ represents either 1 or more of the character that it follows (it always follows a character or a group of characters).

For instance, we have the following pattern https://1blo+cker\.сom. It will match https://1blocker.сom, 1blooocker.сom, https://1blooooooocker.com and so on ad infinitum.

* represents either zero or more of the character that it follows (it also follows a character or a group of characters). So, as it may represent zero characters, there might be nothing in the corresponding position in the URL.

This example https://1blo*ck*r\.сom matches such URLs as https://1blckr.сom, https://1blocker.сom, https://1blooockeer.сom, and so on.

? allows you to match either zero or one of the preceding character or group of characters. In other words, it denotes optionality. You can use it in any pattern to match both http and https versions of the same website.

So the pattern https?://domain.сom will block both http://domain.com and https://domain.сom.

(abc) can capture any subpattern inside of a pair of parentheses as a group, which means that we can apply other special symbols, e.g., +, * or ? to the whole group.

Let’s take a look at this pattern: https://(.*\.)?domain\.com. It will block not only https://domain.com but its subdomains consisting of any number of characters as well, for instance, https://ads.domain.com. Let's break down the pattern. Here we have a group marked by (). The whole group is optional because of ?, and the group itself consists of any number (*) of any characters (.) and an escaped dot \.

^ a caret at the beginning of a pattern restricts the URL to start only with the character that follows the caret(^). Also, a caret inside square brackets tells the engine to match all characters except the ones inside given square brackets.

Here are the examples for both cases:

this pattern ^https://domain\.com will make sure that nothing precedes the letter h, it must be the first character of the string. So, if the target URL is a part of another URL, the rule won’t work: https://anotherdomain.com/https://domain.com.

And an example using caret in square brackets [ ], the pattern https://[^d]omain\.com won’t match domain.com, but will work for lomain.com, romain.com, etc.

Useful Templates

We would like to give you two basic patterns you can apply to create effective custom blocking rules.

.*

It matches any URLs, no matter what characters it contains or their total number.

^https?://+([^:/]+\.)?domain\.com[:/]

Apple recommends using this pattern, as it blocks subdomains and is balanced enough, so you are less likely to see any side-effects.

Let’s break it down into smaller parts:

^https?://+ matches http:// and https:// and makes sure that there is no text before the URL;
([^:/]+\.)? targets all subdomains if there are any;
domain\.com matches the domain itself;
[:/] this tiny part blocks the domain even if the URL contains an extra part after .com. For example, domain.com/page or domain.com:8000

==Referensi==

* https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs

==Pranala Menarik==

* [[Mikrotik]]

@@ Line 1: / Line 1: @@
 Sumber: https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs
-Berikut adalah catatan umum tentang regex, belum tentu 100% jalan di Mikrotik terutama pakai CLI. Sarannya harus di coba2 mana yang bisa jalan. Tampaknya ? dan () sering bermasalah terutama di CLI Mikrotik.
+Berikut adalah catatan umum tentang regex, belum tentu 100% jalan di Mikrotik terutama pakai CLI. Sarannya harus di coba2 mana yang bisa jalan. Tampaknya ?, (, [ sering bermasalah terutama di CLI Mikrotik.
 Dalam regex, setiap karakter "encoded" dan divalidasi simbol demi simbol dari kiri ke kanan. Kita dapat membagi karakter regex menjadi dua grup:

@@ Line 1: / Line 1: @@
 Sumber: https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs
-Berikut adalah catatan umum tentang regex, belum tentu 100% jalan di Mikrotik. Sarannya harus di coba2 mana yang bisa jalan. Tampaknya () sering bermasalah terutama di CLI Mikrotik.
+Berikut adalah catatan umum tentang regex, belum tentu 100% jalan di Mikrotik terutama pakai CLI. Sarannya harus di coba2 mana yang bisa jalan. Tampaknya ? dan () sering bermasalah terutama di CLI Mikrotik.
 Dalam regex, setiap karakter "encoded" dan divalidasi simbol demi simbol dari kiri ke kanan. Kita dapat membagi karakter regex menjadi dua grup:

@@ Line 1: / Line 1: @@
 Sumber: https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs
 Dalam regex, setiap karakter "encoded" dan divalidasi simbol demi simbol dari kiri ke kanan. Kita dapat membagi karakter regex menjadi dua grup:
@@ Line 37: / Line 38: @@
 * ^ tanda sisipan di awal pola membatasi URL untuk memulai hanya dengan karakter yang mengikuti tanda sisipan (^). Juga, Tanda kurung di dalam tanda kurung kotak memberitahu mesin untuk mencocokkan semua karakter kecuali yang di dalam tanda kurung kotak diberikan.
-Here are the examples for both cases:
+Berikut adalah contoh yang dimaksud:
-^https?://+([^:/]+\.)?domain\.com[:/]
+Berikut adalah dua (2) pola dasar yang dapat kita terapkan untuk membuat aturan pemblokiran kustom yang efektif.
-Let’s break it down into smaller parts:
+ .*
-    ^https?://+ matches http:// and https:// and makes sure that there is no text before the URL;
+Itu cocok dengan URL apa pun, tidak peduli karakter apa yang dikandungnya atau jumlah total karakternya.

@@ Line 25: / Line 25: @@
 * . (dot) dapat mencocokkan karakter tunggal apa pun (huruf, angka, spasi putih, apa saja). Jika kita benar-benar membutuhkan titik di URL, jangan lupa untuk meng-escape-nya dengan \. Misalnya, https: //1bl.cker \ .com akan memblokir tidak hanya https://1blocker.com, tetapi juga https://1blucker.com, https://1bl1cker.com, dll.
-    [a-c], [abc] or any set of characters inside [square brackets] will only match any combinations of given characters [abc] or a sequential range of characters [a-c] and nothing else. In other words, the rule will be triggered only if any of the characters given in square brackets are found in the corresponding place in the URL.
+* a-c], [abc] atau serangkaian karakter di dalam [kurung siku] hanya akan cocok dengan kombinasi karakter yang diberikan [abc] atau serangkaian karakter [a-c] berurutan dan tidak ada yang lain. Dengan kata lain, aturan akan dipicu hanya jika salah satu karakter yang diberikan dalam tanda kurung siku ditemukan di tempat yang sesuai di URL. Beberapa contoh: pola https: // 1blocker \. [kc] om sesuai dengan https: //1blocker.сom atau https: //1blocker.kom. Dan omong-omong tentang rentang karakter, https: // [1-3] blocker \ .com akan cocok dengan tiga situs web, https://1blocker.com, https://2blocker.com, dan https://3blocker.com.
-A couple of examples: the pattern https://1blocker\.[kc]om corresponds either to https://1blocker.сom or https://1blocker.kom.
+* + mewakili 1 atau lebih dari karakter yang diikuti (selalu mengikuti karakter atau sekelompok karakter). Misalnya, kami memiliki pola berikut https://1blo+cker\.сom. Ini akan cocok dengan https://1blocker.сom, 1blooocker.сom, https://1blooooooocker.com dan seterusnya hingga tak terhingga.
-And speaking of ranges of characters, https://[1-3]blocker\.com will match three websites, https://1blocker.com, https://2blocker.com, and https://3blocker.com.
+* * mewakili nol atau lebih dari karakter yang diikuti (itu juga mengikuti karakter atau sekelompok karakter). Jadi, karena ini mewakili nol karakter, mungkin tidak ada apa-apa di posisi yang sesuai di URL. Contoh ini https://1blo*ck*r \.сom cocok dengan URL seperti https://1blckr.сom, https://1blocker.сom, https://1blooockeer.сom, dan sebagainya.
-    + represents either 1 or more of the character that it follows (it always follows a character or a group of characters).
+* ? memungkinkan kita untuk mencocokkan dengan nol atau salah satu karakter sebelumnya atau grup karakter. Dengan kata lain, ini menunjukkan opsionalitas. Kita dapat menggunakannya dalam pola apa pun untuk mencocokkan versi http dan https dari situs web yang sama. Jadi polanya https?://domain.сom akan memblokir http://domain.com dan https://domain.сom.
-For instance, we have the following pattern https://1blo+cker\.сom. It will match https://1blocker.сom, 1blooocker.сom, https://1blooooooocker.com and so on ad infinitum.
+* (abc) dapat menangkap subpattern di dalam sepasang tanda kurung sebagai grup, yang berarti bahwa kita dapat menerapkan simbol khusus lainnya, mis., +, * atau? ke seluruh kelompok. Mari kita lihat pola ini: https://(. * \.)?domain\ .com. Ini tidak hanya akan memblokir https://domain.com tetapi juga subdomain yang terdiri dari sejumlah karakter, misalnya, https://ads.domain.com. Mari kita uraikan polanya. Di sini kami memiliki grup yang ditandai oleh (). Seluruh grup bersifat opsional karena?, Dan grup itu sendiri terdiri dari sejumlah (*) karakter apa saja (.) dan sebuah dot yang di escaped \.
-    * represents either zero or more of the character that it follows (it also follows a character or a group of characters). So, as it may represent zero characters, there might be nothing in the corresponding position in the URL.
+* ^ tanda sisipan di awal pola membatasi URL untuk memulai hanya dengan karakter yang mengikuti tanda sisipan (^). Juga, Tanda kurung di dalam tanda kurung kotak memberitahu mesin untuk mencocokkan semua karakter kecuali yang di dalam tanda kurung kotak diberikan.
 Here are the examples for both cases:

@@ Line 19: / Line 19: @@
 Contoh, kita akan memblokir URL: https://domain.com Ada sebuah dot sebelum "com". Mesin akan berfikir ada sebuah karakter sebelum com, tidak harus dot. Contoh, mesin akan match dengan https://domain#com , tentunya bukan yang kita inginkan. Oleh karenanya kita perlu menambahkan backslash sebelum dot agar match secara literal https://domain\.com, sehingga regex akan melihat ada dot sebelum "com".
-Special Characters
+==Special Character==
-If the main idea of regular expressions is a bit clearer now, let’s take a closer look at every special character supported by our engine. Important: these features apply only while creating rules in the Expert editor (available on Premium, learn more: Going Premium).
+Mari kita lihat lebih dalam tentang masing-masing special character.
-    . (dot) can match any single character (letter, digit, whitespace, anything). If you actually need a dot in a URL, don’t forget to escape it with \.
+* . (dot) dapat mencocokkan karakter tunggal apa pun (huruf, angka, spasi putih, apa saja). Jika kita benar-benar membutuhkan titik di URL, jangan lupa untuk meng-escape-nya dengan \. Misalnya, https: //1bl.cker \ .com akan memblokir tidak hanya https://1blocker.com, tetapi juga https://1blucker.com, https://1bl1cker.com, dll.
      [a-c], [abc] or any set of characters inside [square brackets] will only match any combinations of given characters [abc] or a sequential range of characters [a-c] and nothing else. In other words, the rule will be triggered only if any of the characters given in square brackets are found in the corresponding place in the URL.

@@ Line 2: / Line 2: @@
-Using Regex to Block URLs
+Dalam regex, setiap karakter "encoded" dan divalidasi simbol demi simbol dari kiri ke kanan. Kita dapat membagi karakter regex menjadi dua grup:
-This tutorial explains how 1Blocker helps block URLs both efficiently and flexibly. The article is worth reading if you want to dive into one of the most powerful features of 1Blocker.
+* karakter biasa seperti huruf, angka, dan beberapa simbol. Ketika mesin regex bertemu dengan karakter biasa, dia mengartikan karakter seperti apa adanya, tanpa mengubah fungsinya. Misalnya, kata "blocker" regex menggunakan pola yang paling dasar, cukup mencocokkan kata "blocker" yang sebenarnya.
-However, if you find this material a little bit difficult, you can start right from the beginning: Block Sites - we've prepared several articles that give a brief overview of how to create basic custom rules in the Basic Tips section.
+ . - a dot
-Important: the following rule format is valid only for the 'Block URL' type of rules available in the Advanced Customization section.
+Jika URL berisi salah satu karakter spesial, maka karakter tersebut harus di escape menggunakan backslash \.
-While blocking URLs, 1Blocker takes advantage of regular expression patterns or regex. A regular expression represents a sequence of characters written in a special format. Regex patterns are widely used, as they help engines extract information from any text by searching for one or more matches of a specific pattern. In our case, the engine is called WebKit's content blocker - the Safari's engine that processes the rules, and the patterns are represented by any URLs which we want to block.
+Contoh, kita akan memblokir URL: https://domain.com Ada sebuah dot sebelum "com". Mesin akan berfikir ada sebuah karakter sebelum com, tidak harus dot. Contoh, mesin akan match dengan https://domain#com , tentunya bukan yang kita inginkan. Oleh karenanya kita perlu menambahkan backslash sebelum dot agar match secara literal https://domain\.com, sehingga regex akan melihat ada dot sebelum "com".
 Special Characters

@@ Line 99: / Line 99: @@
 * https://support.1blocker.com/hc/en-us/articles/360002309778-Using-Regex-to-Block-URLs
 ==Pranala Menarik==
 * [[Mikrotik]]