You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+40-40Lines changed: 40 additions & 40 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,40 +2,6 @@
2
2
3
3
This project contains a custom processor for [Apache Nifi](https://nifi.apache.org/) which implements a subset of the functionality in the [Stanford CoreNLP](https://stanfordnlp.github.io/CoreNLP/) toolkit.
4
4
5
-
## Installation
6
-
7
-
Create a directory for custom nifi processors if it doesn't exist:
8
-
9
-
```
10
-
mkdir -p $NIFI_HOME/nars/lib1
11
-
```
12
-
13
-
Copy `nifi-stanfordcorenlp-nar-1.0.nar` to `$NIFI_HOME/nars/lib1`
14
-
15
-
Update your `$NIFI_HOME/conf/nifi.properties` to include the following:
16
-
17
-
```
18
-
nifi.nar.library.directory.lib1=/nars/lib1
19
-
```
20
-
21
-
Update your `$NIFI_HOME/conf/bootstrap.conf` with increased memory needed for CoreNLP:
22
-
23
-
```
24
-
# JVM memory settings
25
-
#java.arg.2=-Xms512m
26
-
#java.arg.3=-Xmx512m
27
-
java.arg.2=-Xms4g
28
-
java.arg.3=-Xmx4g
29
-
```
30
-
31
-
Start nifi as usual
32
-
33
-
```
34
-
nifi start
35
-
```
36
-
37
-
For more information on how to configure custom nar files, visit the [Nifi Documentation](https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#core-properties-br).
38
-
39
5
## Usage
40
6
41
7
### Create Input File
@@ -55,14 +21,12 @@ In this example I'm using the standard `GetFile` and `PutFile` processors. They
Assuming the nar file was configured properly in the [Installation](#installation) step, you should be able to search for `Core` or `NLP` to find the `StanfordCoreNLPProcessor`.
59
25
60
-
Assuming the nar file was configured properly in the installation step, you should be able to search for `Core` or `NLP` to find the `StanfordCoreNLPProcessor`.
In the Properties tab of the processor configuration, you will need to configure the entity types that you want to extract from the input as a comma separated list. Here is a brief summary of the configuration options:
67
31
68
32
*`Entity Types`
@@ -86,12 +50,14 @@ In the Properties tab of the processor configuration, you will need to configure
86
50
*`StanfordCoreNLPClient API Secret`
87
51
* Description: StanfordCoreNLPClient API Secret for servers that have authentication configured, not required.
After the `StanfordCoreNLPProcessor` is configured, connect it with inputs and outputs. The processor can terminate with `success` or `failure` relationships.
Start all of the processors in your Nifi flow. In the configured output folder for the `PutFile` component, you should see the updated json file:
@@ -115,6 +81,40 @@ Start all of the processors in your Nifi flow. In the configured output folder f
115
81
}
116
82
```
117
83
84
+
## Installation
85
+
86
+
Create a directory for custom nifi processors if it doesn't exist:
87
+
88
+
```
89
+
mkdir -p $NIFI_HOME/nars/lib1
90
+
```
91
+
92
+
Copy `nifi-stanfordcorenlp-nar-1.0.nar` to `$NIFI_HOME/nars/lib1`
93
+
94
+
Update your `$NIFI_HOME/conf/nifi.properties` to include the following:
95
+
96
+
```
97
+
nifi.nar.library.directory.lib1=/nars/lib1
98
+
```
99
+
100
+
Update your `$NIFI_HOME/conf/bootstrap.conf` with increased memory needed for CoreNLP:
101
+
102
+
```
103
+
# JVM memory settings
104
+
#java.arg.2=-Xms512m
105
+
#java.arg.3=-Xmx512m
106
+
java.arg.2=-Xms4g
107
+
java.arg.3=-Xmx4g
108
+
```
109
+
110
+
Start nifi as usual
111
+
112
+
```
113
+
nifi start
114
+
```
115
+
116
+
For more information on how to configure custom nar files, visit the [Nifi Documentation](https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#core-properties-br).
0 commit comments