update(site): update docs for version 1.3

Author: fhussonnois

site/assets/scss/_variables_project.scss

@@ -38,7 +38,6 @@ $light: $white !default;
 
 table{
     width:100% !important;
-    display: table!important;
 }
 
 .td-box, .td-content {

site/content/en/docs/Developer Guide/configuration.md

@@ -1,5 +1,5 @@
 ---
-date: 2020-05-21
+date: 2020-05-25
 title: "Basic Configuration"
 linkTitle: "Basic Configuration"
 weight: 20
@@ -21,8 +21,14 @@ Those configuration are described in detail in subsequent chapters.
 |`fs.scan.filters` | Filters use to list eligible input files| list | *-* | medium |
 |`filters` | List of filters aliases to apply on each data (order is important) | list | *-* | medium |
 |`internal.kafka.reporter.topic` | Name of the internal topic used by tasks and connector to report and monitor file progression. | class | *connect-file-pulse-status* | high |
-|`internal.kafka.reporter.id` | The reporter identifier which is used as a group.id (must be unique for each connect instance) | string | *-* | high |
 |`internal.kafka.reporter.bootstrap.servers` |A list of host/port pairs uses by the reporter for establishing the initial connection to the Kafka cluster. | string | *-* | high |
 |`task.reader.class` | The fully qualified name of the class which is used by tasks to read input files | class | *io.streamthoughts.kafka.connect.filepulse.reader.RowFileReader* | high |
 |`offset.strategy` | The strategy to use for building source offset from an input file; must be one of [name, path, name+hash] | string | *name+hash* | high |
-|`topic` | The default output topic to write | string | *-* | high |
+|`topic` | The default output topic to write | string | *-* | high |
+
+
+### Prior to Connect FilePulse 1.3.x (deprecated)
+| Configuration |   Description |   Type    |   Default |   Importance  |
+| --------------| --------------|-----------| --------- | ------------- |
+|`internal.kafka.reporter.id` | The reporter identifier to be used by tasks and connector to report and monitor file progression (default null). This property must only be set for users that have run a connector in version prior to 1.3.x to ensure backward-compatibility (when set, must be unique for each connect instance). | string | *-* | high |
+

site/content/en/docs/Developer Guide/scanning-files.md

@@ -1,47 +1,73 @@
 ---
-date: 2020-05-21
+date: 2020-05-25
 title: "Scanning Files"
 linkTitle: "Scanning Files"
 weight: 30
 description: >
   The commons configuration for Connect File Pulse.
 ---
 
-The connector can be configured with a specific [FSDirectoryWalker](https://github.com/streamthoughts/kafka-connect-file-pulse/blob/master/connect-file-pulse-plugin/src/main/java/io/streamthoughts/kafka/connect/filepulse/scanner/local/FSDirectoryWalker.java) 
-implementation that will be responsible to scan an input directory looking for files to stream into Kafka.
+The connector must be configured with a specific [FSDirectoryWalker](https://github.com/streamthoughts/kafka-connect-file-pulse/blob/master/connect-file-pulse-plugin/src/main/java/io/streamthoughts/kafka/connect/filepulse/scanner/local/FSDirectoryWalker.java)  
+that will be responsible for scanning an input directory to find files eligible to be streamed in Kafka.
 
 The default `FSDirectoryWalker` implementation is :
 
 `io.streamthoughts.kafka.connect.filepulse.scanner.local.LocalFSDirectoryWalker`.
 
-When scheduled, the  `LocalFSDirectoryWalker` will recursively scan the input directory configured via  `input.directory.path`.
-The SourceConnector will run a background-thread to periodically trigger a file system scan using the configured FSDirectoryWalker.
+The `FilePulseSourceConnector` periodically triggers a file system scan of the directory specified in the `input.directory.path` 
+connector property. Scan is executed in a background-thread invoking the configured `FSDirectoryWalker`.
 
-## Connector Configuration
+## Configuring Directory Scan (using `LocalFSDirectoryWalker`)
 
 | Configuration |   Description |   Type    |   Default |   Importance  |
 | --------------| --------------|-----------| --------- | ------------- |
 |`fs.scanner.class` | The class used to scan file system | class | *io.streamthoughts.kafka.connect.filepulse.scanner.local.LocalFSDirectoryWalker* | medium |
 |`fs.scan.directory.path` | The input directory to scan | string | *-* | high |
 |`fs.scan.interval.ms` | Time interval in milliseconds at wish the input directory is scanned | long | *10000* | high |
+|`fs.scan.filters` | The comma-separated list of fully qualified class names of the filter-filters to be uses to list eligible input files| list | *-* | medium |
+|`fs.recursive.scan.enable` | Boolean indicating whether local directory should be recursively scanned | boolean | *true* | medium |
 
-## Filter files
+## Filtering input files
 
-Files can be filtered to determine if they need to be scheduled or ignored. Files which are filtered are simply skipped and 
-keep untouched on the file system until next scan. On the next scan, previously filtered files will be evaluate again to determine if there are now eligible to be processing.
+You can configure one or more `FileFilter` that will be used to determine if a file should be scheduled for processing or ignored. 
+All files that are filtered out are simply ignored and remain untouched on the file system until the next scan. 
+At the next scan, previously filtered files will be evaluated again to determine if they are now eligible for processing.
 
-These filters are available for use with Kafka Connect File Pulse:
+FilePulse packs with the following built-in filters :
 
-| Filter | Description |
-|---     | --- |
-| IgnoreHiddenFileFilter | Filters hidden files from being read. |
-| LastModifiedFileFilter | Filters files that been modified to recently based on their last modified date property |
-| RegexFileFilter | Filter file that do not match the specified regex |
+### IgnoreHiddenFileFilter
 
+The `IgnoreHiddenFileFilter` can be used to filter hidden files from being read.
+
+**Configuration example**
+
+```properties
+fs.scan.filters=io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.IgnoreHiddenFileListFilter
+```
+
+### LastModifiedFileFilter
+
+The `LastModifiedFileFilter` can be used to filter files that have been modified to recently based on their last modified date property.
+
+```properties
+fs.scan.filters=io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.LastModifiedFileFilter
+# The last modified time for a file can be accepted (default: 5000)
+file.filter.minimum.age.ms=10000
+```
+
+### RegexFileFilter
+
+The `RegexFileFilter` can be used to filter files that do not match the specified regex.
+
+```properties
+fs.scan.filters=io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.RegexFileFilter
+# The regex pattern used to matches input files
+file.filter.regex.pattern="\\.log$"
+```
 
 ## Supported File types
 
-`LocalFSDirectoryWalker` will try to detect if a file needs to be decompressed by probing its content type or its extension (javadoc : [Files#probeContentType](https://docs.oracle.com/javase/8/docs/api/java/nio/file/Files.html#probeContentType-java.nio.file.Path)
+`LocalFSDirectoryWalker` will try to detect if a file needs to be decompressed by probing its content type or its extension (javadoc : [Files#probeContentType](https://docs.oracle.com/javase/8/docs/api/java/nio/file/Files.html#probeContentType-java.nio.file.Path))
 
 The connector supports the following content types :