01f0f50a-0164-1000-543a-5c35a57e0059
Lab3-NiFi-Learn-Ropes
947d3cfd-1a4d-339f-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
1518.0942119048805
214.12524926085644
1574.0984233306617
177.24500023741894
8b15fad7-d8a2-3971-0000-000000000000
f21ec48b-1e12-35fd-0000-000000000000
PROCESSOR
0 sec
0
A
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
Filter_Attributes
unmatched
8b15fad7-d8a2-3971-0000-000000000000
c6132475-683f-3782-0000-000000000000
PROCESSOR
0
9b3e05ae-45bf-32be-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
a2959013-b38c-3471-0000-000000000000
PROCESSOR
0 sec
1
B
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
Response
8b15fad7-d8a2-3971-0000-000000000000
f21ec48b-1e12-35fd-0000-000000000000
PROCESSOR
0
ad199a8e-7f6c-33dd-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
fd6ac560-692c-3162-0000-000000000000
PROCESSOR
0 sec
1
3
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
matched
unmatched
8b15fad7-d8a2-3971-0000-000000000000
b47ce368-9c1a-35aa-0000-000000000000
PROCESSOR
0
d0d6691d-ba3a-3356-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
df4b8d22-2df9-3e07-0000-000000000000
PROCESSOR
0 sec
1
C
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
matched
unmatched
8b15fad7-d8a2-3971-0000-000000000000
a2959013-b38c-3471-0000-000000000000
PROCESSOR
0
e1468894-febe-3af6-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
5d8c193b-7f34-3667-0000-000000000000
PROCESSOR
0 sec
1
F
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
merged
8b15fad7-d8a2-3971-0000-000000000000
9510e59d-c85f-3890-0000-000000000000
PROCESSOR
0
e44d5628-a5a4-3d70-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
c6132475-683f-3782-0000-000000000000
PROCESSOR
0 sec
1
6
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
matched
unmatched
8b15fad7-d8a2-3971-0000-000000000000
b48adf91-95a5-3413-0000-000000000000
PROCESSOR
0
f5e8b27d-ad40-3200-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
718518ee-77d8-3450-0000-000000000000
PROCESSOR
0 sec
1
4
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
original
split
8b15fad7-d8a2-3971-0000-000000000000
fd6ac560-692c-3162-0000-000000000000
PROCESSOR
0
1af12c7c-0106-3238-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
520.5110979961128
359.99390160460644
8b15fad7-d8a2-3971-0000-000000000000
b47ce368-9c1a-35aa-0000-000000000000
PROCESSOR
0 sec
0
1
success
8b15fad7-d8a2-3971-0000-000000000000
edc7bf02-66fb-3752-0000-000000000000
PROCESSOR
0
39a553f4-26e5-3caf-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
1643.4474833892555
852.7670339288252
8b15fad7-d8a2-3971-0000-000000000000
86c0a2c4-e279-3881-0000-000000000000
PROCESSOR
0 sec
0
D
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
RouteNearbyNeighborhoods
8b15fad7-d8a2-3971-0000-000000000000
df4b8d22-2df9-3e07-0000-000000000000
PROCESSOR
0
6205aec0-9e73-35d3-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
c371acd4-dcaf-3f8c-0000-000000000000
PROCESSOR
0 sec
1
7
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
Filter_Attributes
8b15fad7-d8a2-3971-0000-000000000000
c6132475-683f-3782-0000-000000000000
PROCESSOR
0
6364c70d-ca07-3e0e-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
b48adf91-95a5-3413-0000-000000000000
PROCESSOR
0 sec
1
5
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
success
8b15fad7-d8a2-3971-0000-000000000000
718518ee-77d8-3450-0000-000000000000
PROCESSOR
0
6545b17b-9cad-3e3c-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
e2280a74-1154-31b7-0000-000000000000
PROCESSOR
0 sec
1
9
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
merged
8b15fad7-d8a2-3971-0000-000000000000
198da398-9f50-3b9a-0000-000000000000
PROCESSOR
0
776a29ac-85c9-3d59-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
9510e59d-c85f-3890-0000-000000000000
PROCESSOR
0 sec
1
E
failure
success
8b15fad7-d8a2-3971-0000-000000000000
86c0a2c4-e279-3881-0000-000000000000
PROCESSOR
0
7ecaa21c-e572-33a3-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1 GB
10000
8b15fad7-d8a2-3971-0000-000000000000
198da398-9f50-3b9a-0000-000000000000
PROCESSOR
0 sec
1
8
org.apache.nifi.prioritizer.FirstInFirstOutPrioritizer
org.apache.nifi.prioritizer.OldestFlowFileFirstPrioritizer
failure
success
8b15fad7-d8a2-3971-0000-000000000000
c371acd4-dcaf-3f8c-0000-000000000000
PROCESSOR
0
86c0a2c4-e279-3881-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1085.2956265218459
732.6919086207167
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Attributes List
Attributes List
attributes-to-json-regex
attributes-to-json-regex
Destination
Destination
Include Core Attributes
Include Core Attributes
Null Value
Null Value
ALL
false
30 sec
Attributes List
Vehicle_ID, city, Latitude, Longitude, neighborhoods_nearby, Last_Time
attributes-to-json-regex
Destination
flowfile-content
Include Core Attributes
true
Null Value
false
0
0 sec
TIMER_DRIVEN
1 sec
AttributesToJSON
false
failure
false
success
STOPPED
org.apache.nifi.processors.standard.AttributesToJSON
9510e59d-c85f-3890-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
253.98618610612402
747.177757677453
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Merge Strategy
Merge Strategy
Merge Format
Merge Format
Attribute Strategy
Attribute Strategy
Correlation Attribute Name
Correlation Attribute Name
mergecontent-metadata-strategy
mergecontent-metadata-strategy
Minimum Number of Entries
Minimum Number of Entries
Maximum Number of Entries
Maximum Number of Entries
Minimum Group Size
Minimum Group Size
Maximum Group Size
Maximum Group Size
Max Bin Age
Max Bin Age
Maximum number of Bins
Maximum number of Bins
Delimiter Strategy
Delimiter Strategy
Header File
Header File
Footer File
Footer File
Demarcator File
Demarcator File
Compression Level
Compression Level
Keep Path
Keep Path
Tar Modified Time
Tar Modified Time
ALL
false
30 sec
Merge Strategy
Bin-Packing Algorithm
Merge Format
Binary Concatenation
Attribute Strategy
Keep Only Common Attributes
Correlation Attribute Name
mergecontent-metadata-strategy
Do Not Merge Uncommon Metadata
Minimum Number of Entries
10
Maximum Number of Entries
15
Minimum Group Size
0 B
Maximum Group Size
Max Bin Age
Maximum number of Bins
5
Delimiter Strategy
Text
Header File
[
Footer File
]
Demarcator File
,
Compression Level
1
Keep Path
false
Tar Modified Time
${file.lastModifiedTime}
0
0 sec
TIMER_DRIVEN
1 sec
MergeContent
false
failure
false
merged
true
original
STOPPED
org.apache.nifi.processors.standard.MergeContent
a2959013-b38c-3471-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1502.2600288224307
339.47851570326145
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Destination
Destination
Return Type
Return Type
Path Not Found Behavior
Path Not Found Behavior
Null Value Representation
Null Value Representation
city
city
neighborhoods_nearby
neighborhoods_nearby
ALL
false
30 sec
Destination
flowfile-attribute
Return Type
json
Path Not Found Behavior
ignore
Null Value Representation
empty string
city
$.results[0].vicinity
neighborhoods_nearby
$.results[*].name
0
0 sec
TIMER_DRIVEN
1 sec
EvaluateJsonPath
false
failure
false
matched
false
unmatched
STOPPED
org.apache.nifi.processors.standard.EvaluateJsonPath
b47ce368-9c1a-35aa-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
780.214396060762
433.6041660308838
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Destination
Destination
Return Type
Return Type
Validate DTD
Validate DTD
Last_Time
Last_Time
ALL
false
30 sec
Destination
flowfile-attribute
Return Type
auto-detect
Validate DTD
true
Last_Time
//body/lastTime/@time
0
0 sec
TIMER_DRIVEN
1 sec
EvaluateXPath
false
failure
false
matched
false
unmatched
STOPPED
org.apache.nifi.processors.standard.EvaluateXPath
b48adf91-95a5-3413-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1141.214396060762
29.604196548461942
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Destination
Destination
Return Type
Return Type
Validate DTD
Validate DTD
Direction_of_Travel
Direction_of_Travel
Latitude
Latitude
Longitude
Longitude
Vehicle_ID
Vehicle_ID
Vehicle_Speed
Vehicle_Speed
ALL
false
30 sec
Destination
flowfile-attribute
Return Type
auto-detect
Validate DTD
true
Direction_of_Travel
//vehicle/@dirTag
Latitude
//vehicle/@lat
Longitude
//vehicle/@lon
Vehicle_ID
//vehicle/@id
Vehicle_Speed
//vehicle/@speedKmHr
0
0 sec
TIMER_DRIVEN
1 sec
EvaluateXPath
false
failure
false
matched
false
unmatched
STOPPED
org.apache.nifi.processors.standard.EvaluateXPath
c371acd4-dcaf-3f8c-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1185.8243814123246
482.6670627593994
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Attributes List
Attributes List
attributes-to-json-regex
attributes-to-json-regex
Destination
Destination
Include Core Attributes
Include Core Attributes
Null Value
Null Value
ALL
false
30 sec
Attributes List
Vehicle_ID, Direction_of_Travel, Latitude, Longitude, Vehicle_Speed, Last_Time
attributes-to-json-regex
Destination
flowfile-content
Include Core Attributes
true
Null Value
false
0
0 sec
TIMER_DRIVEN
1 sec
AttributesToJSON
false
failure
false
success
STOPPED
org.apache.nifi.processors.standard.AttributesToJSON
c6132475-683f-3782-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1103.214396060762
269.6041965484619
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Routing Strategy
Routing Strategy
Filter_Attributes
Filter_Attributes
ALL
false
30 sec
Routing Strategy
Route to Property name
Filter_Attributes
${Direction_of_Travel:isEmpty():not():and(${Last_Time:isEmpty():not()}):and(${Latitude:isEmpty():not()}):and(${Longitude:isEmpty():not()}):and(${Vehicle_ID:isEmpty():not()}):and(${Vehicle_Speed:equals('0'):not()})}
0
0 sec
TIMER_DRIVEN
1 sec
RouteOnAttribute
false
Filter_Attributes
false
unmatched
STOPPED
org.apache.nifi.processors.standard.RouteOnAttribute
df4b8d22-2df9-3e07-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1483.7869745010535
656.1603442319492
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Routing Strategy
Routing Strategy
RouteNearbyNeighborhoods
RouteNearbyNeighborhoods
ALL
false
30 sec
Routing Strategy
Route to Property name
RouteNearbyNeighborhoods
${city:isEmpty():not():and(${neighborhoods_nearby:isEmpty():not()})}
0
0 sec
TIMER_DRIVEN
1 sec
RouteOnAttribute
false
RouteNearbyNeighborhoods
true
unmatched
STOPPED
org.apache.nifi.processors.standard.RouteOnAttribute
e2280a74-1154-31b7-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
0.0
206.16330621266957
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Create Missing Directories
Create Missing Directories
Maximum File Count
Maximum File Count
Last Modified Time
Last Modified Time
Permissions
Permissions
Owner
Owner
Group
Group
ALL
false
30 sec
Directory
./data-out/filtered_transitLoc_data
Conflict Resolution Strategy
fail
Create Missing Directories
true
Maximum File Count
Last Modified Time
Permissions
Owner
Group
0
0 sec
TIMER_DRIVEN
1 sec
PutFile
true
failure
true
success
STOPPED
org.apache.nifi.processors.standard.PutFile
edc7bf02-66fb-3752-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
126.40907474215487
2.44168706384653
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
URL
URL
Filename
Filename
SSL Context Service
org.apache.nifi.ssl.SSLContextService
SSL Context Service
Username
Username
Password
Password
Connection Timeout
Connection Timeout
Data Timeout
Data Timeout
User Agent
User Agent
Accept Content-Type
Accept Content-Type
Follow Redirects
Follow Redirects
redirect-cookie-policy
redirect-cookie-policy
Proxy Host
Proxy Host
Proxy Port
Proxy Port
ALL
false
30 sec
URL
http://webservices.nextbus.com/service/publicXMLFeed?command=vehicleLocations&a=sf-muni&t=0
Filename
vehicleLoc_SF_OceanView_${now():format("HHmmssSSS")}.xml
SSL Context Service
Username
Password
Connection Timeout
30 sec
Data Timeout
30 sec
User Agent
Accept Content-Type
Follow Redirects
false
redirect-cookie-policy
default
Proxy Host
Proxy Port
0
1 sec
TIMER_DRIVEN
1 sec
GetHTTP
false
success
STOPPED
org.apache.nifi.processors.standard.GetHTTP
f21ec48b-1e12-35fd-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
1528.650112184033
38.630724906331125
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
HTTP Method
HTTP Method
Remote URL
Remote URL
SSL Context Service
org.apache.nifi.ssl.SSLContextService
SSL Context Service
Connection Timeout
Connection Timeout
Read Timeout
Read Timeout
Include Date Header
Include Date Header
Follow Redirects
Follow Redirects
Attributes to Send
Attributes to Send
Basic Authentication Username
Basic Authentication Username
Basic Authentication Password
Basic Authentication Password
Proxy Host
Proxy Host
Proxy Port
Proxy Port
Proxy Type
Proxy Type
invokehttp-proxy-user
invokehttp-proxy-user
invokehttp-proxy-password
invokehttp-proxy-password
Put Response Body In Attribute
Put Response Body In Attribute
Max Length To Put In Attribute
Max Length To Put In Attribute
Digest Authentication
Digest Authentication
Always Output Response
Always Output Response
Trusted Hostname
Trusted Hostname
Add Response Headers to Request
Add Response Headers to Request
Content-Type
Content-Type
send-message-body
send-message-body
Use Chunked Encoding
Use Chunked Encoding
Penalize on "No Retry"
Penalize on "No Retry"
use-etag
use-etag
etag-max-cache-size
etag-max-cache-size
ALL
false
30 sec
HTTP Method
GET
Remote URL
https://maps.googleapis.com/maps/api/place/nearbysearch/json?location=${Latitude},${Longitude}&radius=500&type=neighborhood&key=[取得したAPIキー]
SSL Context Service
Connection Timeout
5 secs
Read Timeout
15 secs
Include Date Header
True
Follow Redirects
True
Attributes to Send
Basic Authentication Username
Basic Authentication Password
Proxy Host
Proxy Port
Proxy Type
http
invokehttp-proxy-user
invokehttp-proxy-password
Put Response Body In Attribute
Max Length To Put In Attribute
256
Digest Authentication
false
Always Output Response
false
Trusted Hostname
Add Response Headers to Request
false
Content-Type
${mime.type}
send-message-body
true
Use Chunked Encoding
false
Penalize on "No Retry"
false
use-etag
false
etag-max-cache-size
10MB
0
0 sec
TIMER_DRIVEN
1 sec
InvokeHTTP
true
Failure
true
No Retry
true
Original
false
Response
true
Retry
STOPPED
org.apache.nifi.processors.standard.InvokeHTTP
fd6ac560-692c-3162-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
639.214396060762
221.6041965484619
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Split Depth
Split Depth
ALL
false
30 sec
Split Depth
1
0
0 sec
TIMER_DRIVEN
1 sec
SplitXml
false
failure
false
original
false
split
STOPPED
org.apache.nifi.processors.standard.SplitXml
198da398-9f50-3b9a-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
532.0138345373246
593.7528781890869
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Merge Strategy
Merge Strategy
Merge Format
Merge Format
Attribute Strategy
Attribute Strategy
Correlation Attribute Name
Correlation Attribute Name
mergecontent-metadata-strategy
mergecontent-metadata-strategy
Minimum Number of Entries
Minimum Number of Entries
Maximum Number of Entries
Maximum Number of Entries
Minimum Group Size
Minimum Group Size
Maximum Group Size
Maximum Group Size
Max Bin Age
Max Bin Age
Maximum number of Bins
Maximum number of Bins
Delimiter Strategy
Delimiter Strategy
Header File
Header File
Footer File
Footer File
Demarcator File
Demarcator File
Compression Level
Compression Level
Keep Path
Keep Path
Tar Modified Time
Tar Modified Time
ALL
false
30 sec
Merge Strategy
Bin-Packing Algorithm
Merge Format
Binary Concatenation
Attribute Strategy
Keep Only Common Attributes
Correlation Attribute Name
mergecontent-metadata-strategy
Do Not Merge Uncommon Metadata
Minimum Number of Entries
10
Maximum Number of Entries
15
Minimum Group Size
0 B
Maximum Group Size
Max Bin Age
Maximum number of Bins
5
Delimiter Strategy
Text
Header File
[
Footer File
]
Demarcator File
,
Compression Level
1
Keep Path
false
Tar Modified Time
${file.lastModifiedTime}
0
0 sec
TIMER_DRIVEN
1 sec
MergeContent
false
failure
false
merged
true
original
STOPPED
org.apache.nifi.processors.standard.MergeContent
5d8c193b-7f34-3667-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
17.433266171025934
518.3159193906531
nifi-standard-nar
org.apache.nifi
1.6.0
WARN
1
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Create Missing Directories
Create Missing Directories
Maximum File Count
Maximum File Count
Last Modified Time
Last Modified Time
Permissions
Permissions
Owner
Owner
Group
Group
ALL
false
30 sec
Directory
./data-out/nearby_neighborhoods_search
Conflict Resolution Strategy
fail
Create Missing Directories
true
Maximum File Count
Last Modified Time
Permissions
Owner
Group
0
0 sec
TIMER_DRIVEN
1 sec
PutFile
true
failure
true
success
STOPPED
org.apache.nifi.processors.standard.PutFile
718518ee-77d8-3450-0000-000000000000
8b15fad7-d8a2-3971-0000-000000000000
518.1298623693558
0.0
nifi-update-attribute-nar
org.apache.nifi
1.6.0
WARN
1
Delete Attributes Expression
Delete Attributes Expression
Store State
Store State
Stateful Variables Initial Value
Stateful Variables Initial Value
filename
filename
ALL
false
30 sec
Delete Attributes Expression
Store State
Do not store state
Stateful Variables Initial Value
filename
${UUID()}
0
0 sec
TIMER_DRIVEN
1 sec
UpdateAttribute
false
success
STOPPED
org.apache.nifi.processors.attributes.UpdateAttribute
07/09/2018 11:38:25 JST