Ben Hsieh a07b93aa89 Fix IOS task queue race condition issue when sending massive requests | 8 gadus atpakaļ | |
---|---|---|
.github | 8 gadus atpakaļ | |
img | 8 gadus atpakaļ | |
src | 8 gadus atpakaļ | |
test | 8 gadus atpakaļ | |
test-server | 8 gadus atpakaļ | |
.gitignore | 8 gadus atpakaļ | |
LICENSE | 8 gadus atpakaļ | |
README.md | 8 gadus atpakaļ | |
package.json | 8 gadus atpakaļ | |
test.sh | 8 gadus atpakaļ |
A project committed to make file acess and data transfer easier, effiecient for React Native developers.
This project was initially for solving the issue facebook/react-native#854, because React Native lack of Blob
implementation and it will cause some problem when transfering binary data. Now, this project is committed to make file access and transfer more easier, effiecient for React Native developers. We’ve implemented highly customizable filesystem and network module which plays well together. For example, upload and download data directly from/to storage which is much more efficient in some cases(especially for large ones). The file system supports file stream, so you don’t have to worry about OOM problem when accessing large files.
In 0.8.0
we introduced experimential Web API polyfills that make it possible to use browser-based libraries in React Native, for example, FireBase JS SDK
Install package from npm
npm install --save react-native-fetch-blob
Link package using rnpm
rnpm link
If rnpm link command failed to link the package automatically, you might try manually link the package.
Open android/settings.gradle
, and add these lines which will app RNFetchBlob Android project dependency to your app.
include ':app'
+ include ':react-native-fetch-blob'
+ project(':react-native-fetch-blob').projectDir = new File(rootProject.projectDir,' ../node_modules/react-native-fetch-blob/android')
Add this line to MainApplication.java
, so that RNFetchBlob package becomes part of react native package.
...
+ import com.RNFetchBlob.RNFetchBlobPackage;
...
protected List<ReactPackage> getPackages() {
return Arrays.<ReactPackage>asList(
new MainReactPackage(),
+ new RNFetchBlobPackage()
);
}
};
...
If you still having problem on installing this package, please check the trouble shooting page or file an issue
Grant Permission to External storage for Android 5.0 or lower
Mechanism about granting Android permissions has slightly different since Android 6.0 released, please refer to Official Document.
If you’re going to access external storage (say, SD card storage) for Android 5.0
(or lower) devices, you might have to add the following line to AndroidManifest.xml
.
<manifest xmlns:android="http://schemas.android.com/apk/res/android"
package="com.rnfetchblobtest"
android:versionCode="1"
android:versionName="1.0">
<uses-permission android:name="android.permission.INTERNET" />
<uses-permission android:name="android.permission.SYSTEM_ALERT_WINDOW"/>
+ <uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" />
+ <uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE" />
...
Also, if you’re going to use Android Download Manager
you have to add this to AndroidManifetst.xml
<intent-filter>
<action android:name="android.intent.action.MAIN" />
<category android:name="android.intent.category.LAUNCHER" />
+ <action android:name="android.intent.action.DOWNLOAD_COMPLETE"/>
</intent-filter>
Grant Access Permission for Android 6.0
Beginning in Android 6.0 (API level 23), users grant permissions to apps while the app is running, not when they install the app. So adding permissions in AndroidManifest.xml
won’t work in Android 6.0 devices. To grant permissions in runtime, you might use modules like react-native-android-permissions.
ES6
The module uses ES6 style export statement, simply use import
to load the module.
import RNFetchBlob from 'react-native-fetch-blob'
ES5
If you’re using ES5 require statement to load the module, please add default
. See here for more detail.
var RNFetchBlob = require('react-native-fetch-blob').default
After 0.8.0
react-native-fetch-blob automatically decide how to send the body by checking its type and Content-Type
in header. The rule is described in the following diagram
To sum up :
Content-Type
header won’t take effect if the body is an Array
because we will set proper content type for you.Content-Type
header does not matters.
Content-Type
header filed must containing substring;BASE64
or application/octet
RNFetchBlob-file://
, which can simply done by RNFetchBlob.wrap(PATH_TO_THE_FILE)
Content-Type
header not containing ;BASE64
or application/octet
.Most simple way is download to memory and stored as BASE64 encoded string, this is handy when the response data is small.
// send http request in a new thread (using native code)
RNFetchBlob.fetch('GET', 'http://www.example.com/images/img1.png', {
Authorization : 'Bearer access-token...',
// more headers ..
})
// when response status code is 200
.then((res) => {
// the conversion is done in native code
let base64Str = res.base64()
// the following conversions are done in js, it's SYNC
let text = res.text()
let json = res.json()
})
// Status code is not 200
.catch((errorMessage, statusCode) => {
// error handling
})
If the response data is large, that would be a bad idea to convert it into BASE64 string. The better solution is store the response data directly into file system. The simplest way is give a fileCache
option to config, and set it to true
. This will make incoming response data stored in a temporary path without any file extension.
These files won’t be removed automatically, please refer to Cache File Management
RNFetchBlob
.config({
// add this option that makes response data to be stored as a file,
// this is much more performant.
fileCache : true,
})
.fetch('GET', 'http://www.example.com/file/example.zip', {
some headers ..
})
.then((res) => {
// the temp file path
console.log('The file saved to ', res.path())
})
Set Temp File Extension
Sometimes you might need a file extension for some reason. For instance, when using file path as source of Image
component, the path should end with something like .png or .jpg, you can do this by add appendExt
option to config
.
RNFetchBlob
.config({
fileCache : true,
// by adding this option, the temp files will have a file extension
appendExt : 'png'
})
.fetch('GET', 'http://www.example.com/file/example.zip', {
some headers ..
})
.then((res) => {
// the temp file path with file extension `png`
console.log('The file saved to ', res.path())
// Beware that when using a file path as Image source on Android,
// you must prepend "file://"" before the file path
imageView = <Image source={{ uri : Platform.OS === 'android' ? 'file://' + res.path() : '' + res.path() }}/>
})
Use Specific File Path
If you prefer a specific path rather than randomly generated one, you can use path
option. We’ve added a constant dirs in v0.5.0 that contains several common used directories.
let dirs = RNFetchBlob.fs.dirs
RNFetchBlob
.config({
// response data will be saved to this path if it has access right.
path : dirs.DocumentDir + '/path-to-file.anything'
})
.fetch('GET', 'http://www.example.com/file/example.zip', {
//some headers ..
})
.then((res) => {
// the path should be dirs.DocumentDir + 'path-to-file.anything'
console.log('The file saved to ', res.path())
})
These files won’t be removed automatically, please refer to Cache File Management
react-native-fetch-blob
will convert the base64 string in body
to binary format using native API, this process will be done in a new thread, so it’s async.
RNFetchBlob.fetch('POST', 'https://content.dropboxapi.com/2/files/upload', {
Authorization : "Bearer access-token...",
'Dropbox-API-Arg': JSON.stringify({
path : '/img-from-react-native.png',
mode : 'add',
autorename : true,
mute : false
}),
'Content-Type' : 'application/octet-stream',
// here's the body you're going to send, should be a BASE64 encoded string
// (you can use "base64" APIs to make one).
// The data will be converted to "byte array"(say, blob) before request sent.
}, base64ImageString)
.then((res) => {
console.log(res.text())
})
.catch((err) => {
// error handling ..
})
If you’re going to use a file
request body, just wrap the path with wrap
API.
RNFetchBlob.fetch('POST', 'https://content.dropboxapi.com/2/files/upload', {
// dropbox upload headers
Authorization : "Bearer access-token...",
'Dropbox-API-Arg': JSON.stringify({
path : '/img-from-react-native.png',
mode : 'add',
autorename : true,
mute : false
}),
'Content-Type' : 'application/octet-stream',
// Change BASE64 encoded data to a file path with prefix `RNFetchBlob-file://`.
// Or simply wrap the file path with RNFetchBlob.wrap().
}, RNFetchBlob.wrap(PATH_TO_THE_FILE))
.then((res) => {
console.log(res.text())
})
.catch((err) => {
// error handling ..
})
In version >= 0.3.0
you can also post files with form data, just put an array in body
, with elements have property name
, data
, and filename
(optional).
Elements have property filename
will be transformed into binary format, otherwise it turns into utf8 string.
RNFetchBlob.fetch('POST', 'http://www.example.com/upload-form', {
Authorization : "Bearer access-token",
otherHeader : "foo",
'Content-Type' : 'multipart/form-data',
}, [
// element with property `filename` will be transformed into `file` in form data
{ name : 'avatar', filename : 'avatar.png', data: binaryDataInBase64},
// custom content type
{ name : 'avatar-png', filename : 'avatar-png.png', type:'image/png', data: binaryDataInBase64},
// part file from storage
{ name : 'avatar-foo', filename : 'avatar-foo.png', type:'image/foo', data: RNFetchBlob.wrap(path_to_a_file)},
// elements without property `filename` will be sent as plain text
{ name : 'name', data : 'user'},
{ name : 'info', data : JSON.stringify({
mail : 'example@example.com',
tel : '12345678'
})},
]).then((resp) => {
// ...
}).catch((err) => {
// ...
})
What if you want to upload a file in some field ? Just like upload a file from storage example, wrap data
by wrap
API (this feature is only available for version >= v0.5.0
). On version >= 0.6.2
, it is possible to set custom MIME type when appending file to form data.
RNFetchBlob.fetch('POST', 'http://www.example.com/upload-form', {
Authorization : "Bearer access-token",
otherHeader : "foo",
// this is required, otherwise it won't be process as a multipart/form-data request
'Content-Type' : 'multipart/form-data',
}, [
// append field data from file path
{
name : 'avatar',
filename : 'avatar.png',
// Change BASE64 encoded data to a file path with prefix `RNFetchBlob-file://`.
// Or simply wrap the file path with RNFetchBlob.wrap().
data: RNFetchBlob.wrap(PATH_TO_THE_FILE)
},
{
name : 'ringtone',
filename : 'ring.mp3',
// use custom MIME type
type : 'application/mp3',
// upload a file from asset is also possible in version >= 0.6.2
data : RNFetchBlob.wrap(RNFetchBlob.fs.asset('default-ringtone.mp3'))
}
// elements without property `filename` will be sent as plain text
{ name : 'name', data : 'user'},
{ name : 'info', data : JSON.stringify({
mail : 'example@example.com',
tel : '12345678'
})},
]).then((resp) => {
// ...
}).catch((err) => {
// ...
})
In version >= 0.4.2
it is possible to know the upload/download progress. After 0.7.0
IOS and Android upload progress are supported.
RNFetchBlob.fetch('POST', 'http://www.example.com/upload', {
... some headers,
'Content-Type' : 'octet-stream'
}, base64DataString)
// listen to upload progress event
.uploadProgress((written, total) => {
console.log('uploaded', written / total)
})
// listen to download progress event
.progress((received, total) => {
console.log('progress', received / total)
})
.then((resp) => {
// ...
})
.catch((err) => {
// ...
})
After 0.7.0
it is possible to cancel a HTTP request. When the request cancel, it will definately throws an promise rejection, be sure to catch it.
let task = RNFetchBlob.fetch('GET', 'http://example.com/file/1')
task.then(() => { ... })
// handle request cancelled rejection
.catch((err) => {
console.log(err)
})
// cancel the request, the callback function is optional
task.cancel((err) => { ... })
If you want to make a file in External Storage
becomes visible in Picture, Downloads, or other built-in apps, you will have to use Media Scanner
or Download Manager
.
Media Scanner
Media scanner scan the file and categorize by given MIME type, if MIME type not specified, it will try to resolve the file using its file extension.
RNFetchBlob
.config({
// DCIMDir is in external storage
path : dirs.DCIMDir + '/music.mp3'
})
.fetch('GET', 'http://example.com/music.mp3')
.then((res) => RNFetchBlob.fs.scanFile([ { path : res.path(), mime : 'audio/mpeg' } ]))
.then(() => {
// scan file success
})
.catch((err) => {
// scan file error
})
Download Manager
When download large files on Android it is recommended to use Download Manager
, it supports lot of native features like progress bar, and notification, also the download task will be handled by OS, and more effective.
When using DownloadManager, fileCache
and path
properties in config
will not take effect, because Android DownloadManager can only store files to external storage. When download complete, DownloadManager will generate a file path so that you can deal with it.
RNFetchBlob
.config({
addAdnroidDownloads : {
useDownloadManager : true, // <-- this is the only thing required
// Optional, override notification setting (default to true)
notification : false,
// Optional, but recommended since android DownloadManager will fail when
// the url does not contains a file extension, by default the mime type will be text/plain
mime : 'text/plain',
description : 'File downloaded by download manager.'
}
})
.fetch('GET', 'http://example.com/file/somefile')
.then((resp) => {
// the path of downloaded file
resp.path()
})
Download Notification and Visibiliy in Download App (Android Only)
If you want to display a notification when file’s completely download to storage (as the above), or make the downloaded file visible in “Downloads” app. You have to add some options to config
.
RNFetchBlob.config({
fileCache : true,
// android only options, these options be a no-op on IOS
addAndroidDownloads : {
// Show notification when response data transmitted
notification : true,
// Title of download notification
title : 'Great ! Download Success ! :O ',
// File description (not notification description)
description : 'An image file.',
mime : 'image/png',
// Make the file scannable by media scanner
meidaScannable : true,
}
})
.fetch('GET', 'http://example.com/image1.png')
.then(...)
File access APIs were made when developing v0.5.0
, which helping us write tests, and was not planned to be a part of this module. However we realized that, it’s hard to find a great solution to manage cached files, every one who use this moudle may need these APIs for there cases.
Before start using file APIs, we recommend read Differences between File Source first.
File Access APIs
See File API for more information
In v0.5.0
we’ve added writeStream
and readStream
, which allows your app read/write data from file path. This API creates a file stream, rather than convert whole data into BASE64 encoded string, it’s handy when processing large files.
When calling readStream
method, you have to open
the stream, and start to read data.
let data = ''
RNFetchBlob.fs.readStream(
// encoding, should be one of `base64`, `utf8`, `ascii`
'base64',
// file path
PATH_TO_THE_FILE,
// (optional) buffer size, default to 4096 (4095 for BASE64 encoded data)
// when reading file in BASE64 encoding, buffer size must be multiples of 3.
4095)
.then((ifstream) => {
ifstream.open()
ifstream.onData((chunk) => {
// when encoding is `ascii`, chunk will be an array contains numbers
// otherwise it will be a string
data += chunk
})
ifstream.onError((err) => {
console.log('oops', err)
})
ifstream.onEnd(() => {
<Image source={{ uri : 'data:image/png,base64' + data }}
})
})
When use writeStream
, the stream is also opened immediately, but you have to write
, and close
by yourself.
RNFetchBlob.fs.writeStream(
PATH_TO_FILE,
// encoding, should be one of `base64`, `utf8`, `ascii`
'utf8',
// should data append to existing content ?
true)
.then((ofstream) => {
ofstream.write('foo')
ofstream.write('bar')
ofstream.close()
})
When using fileCache
or path
options along with fetch
API, response data will automatically stored into file system. The files will NOT removed unless you unlink
it. There’re several ways to remove the files
// remove file using RNFetchblobResponse.flush() object method
RNFetchblob.config({
fileCache : true
})
.fetch('GET', 'http://example.com/download/file')
.then((res) => {
// remove cached file from storage
res.flush()
})
// remove file by specifying a path
RNFetchBlob.fs.unlink('some-file-path').then(() => {
// ...
})
You can also grouping requests by using session
API, and use dispose
to remove them all when needed.
RNFetchblob.config({
fileCache : true
})
.fetch('GET', 'http://example.com/download/file')
.then((res) => {
// set session of a response
res.session('foo')
})
RNFetchblob.config({
// you can also set session beforehand
session : 'foo'
fileCache : true
})
.fetch('GET', 'http://example.com/download/file')
.then((res) => {
// ...
})
// or put an existing file path to the session
RNFetchBlob.session('foo').add('some-file-path')
// remove a file path from the session
RNFetchBlob.session('foo').remove('some-file-path')
// list paths of a session
RNFetchBlob.session('foo').list()
// remove all files in a session
RNFetchBlob.session('foo').dispose().then(() => { ... })
By default, react-native-fetch-blob does NOT allow connection to unknown certification provider since it’s dangerous. If you’re going to connect a server with self-signed certification, add trusty
to config
. This function is available for version >= 0.5.3
RNFetchBlob.config({
trusty : true
})
.then('GET', 'https://mysite.com')
.then((resp) => {
// ...
})
After 0.8.0
we’ve made some Web API polyfills that makes some browser-based library available in RN.
Reduce RCT Bridge Overhead and BASE64 Time
React Native connects JS and Native context by passing JSON through React bridge, therefore there will be an overhead to convert data before they sent. When data is large, this will be quite a performance impact to your app, it’s recommended to use file storage instead of BASE64 if possible. The following chart shows how much faster when loading data from storage than BASE64 encoded string on iphone 6.
ASCII Encoding has /terrible Performance
Due to the lack of typed array implementation in JavascriptCore, and limitation of React Native structure, to convert data to JS byte array spends lot of time. Use it only when needed, the following chart shows how much time it takes when reading a file with different encoding.
Concate and Replacing Files
If you’re going to concatenate files, you don’t have to read the data to JS context anymore ! In 0.8.0
we introduced new encoding uri
for writeFile and appendFile API. Which make it possible to done the whole process in native.
Version | |
---|---|
0.8.1 | Remove Web API log and fix ios progress report function. |
0.8.0 | Added Web API polyfills, support regular request, added timeout option. |
0.7.5 | Fix installation script that make it compatible to react-native < 0.28 |
0.7.4 | Fix app crash problem in version > 0.27 |
0.7.3 | Fix OkHttp dependency issue in version < 0.29 |
0.7.2 | Fix cancel request bug |
0.7.1 | Fix #57 ios module could not compile on ios version <= 9.3 |
0.7.0 | Add support of Android upload progress, and remove AsyncHttpClient dependency from Android native implementation. |
0.6.4 | Fix rnpm link script. |
0.6.3 | Fix performance issue on IOS, increase max concurrent request limitation from 1. |
0.6.2 | Add support of asset file and camera roll files, Support custom MIME type when sending multipart request, thanks @smartt |
0.6.1 | Fix #37 progress report API issue on IOS |
0.6.0 | Add readFile and writeFile API for easier file access, also added Android download manager support. |
0.5.8 | Fix #33 PUT request will always be sent as POST on Android |
0.5.7 | Fix #31 #30 Xcode pre 7.3 build error |
0.5.6 | Add support for IOS network status indicator. Fix file stream ASCII reader bug. |
0.5.5 | Remove work in progress code added in 0.5.2 which may cause memory leaks. |
0.5.4 | Fix #30 #31 build build error, and improve memory efficiency. |
0.5.3 | Add API for access untrusted SSL server |
0.5.2 | Fix improper url params bug #26 and change IOS HTTP implementation from NSURLConnection to NSURLSession |
0.5.0 | Upload/download with direct access to file storage, and also added file access APIs |
0.4.2 | Supports upload/download progress |
0.4.1 | Fix upload form-data missing file extension problem on Android |
0.4.0 | Add base-64 encode/decode library and API |
~0.3.0 | Upload/Download octet-stream and form-data |
If you’re interested in hacking this module, check our development guide, there might be some helpful information. Please feel free to make a PR or file an issue.