To consider when transfering calibrations or databases (part 2)

When we transfer a calibration or a database from one instrument to other, we know in advance that we have a sample presentation error in the instrument where the calibration comes from, and it is important to know it before you interpret the statistics.

In this case I know the predictions from several samples acquired in two repacks, so the sample result we consider is the average, but in this case we are interested in the individual results of every repack (2 results in this case). So I can calculate the difference of both results for every repack and after that (with all the values) I can calculate the standard deviation to get what I can consider the repacking error.

Notice that I will have a value of standard deviation for every parameter.

So I can compare this value with the errors the monitor function gives to me.

The error packaging for the moisture in wheat for a NIR5000 with natural product cell was 0,11. After an standardization to transfer the database to a DS2500 I get an RMSEP error of 0,21, but I can see that maybe due to the samples chosen for the standardization I have an slope which affects specially to the samples with high moisture. But I can see also that the error once than the slope and intercept are corrected is Sres=0,12 , very similar to the repacking error, so there is a good improvement which makes me challenge to try a better standardization to improve the calibration or database transfer.

To consider when transfering calibrations or databases (part 1)

There are some occasions where we have to transfer equations or databases from one instrument to other and both instruments have a different sample presentation system, so there is no possibility to scan the same sample in the same cuvette. In this case we have to make some repacking form one cuvette to the other at the same time that we scan the sample on the correspondent instrument. 

It is very important that the sample must be as well homogenized as possible between repacks. As you make more repacks there is a higher possibility that the same sample is presented to both instruments so we can make a better standardization.

But which sample must be chosen for the standardization and to make the repacks. One option is to use a sample with an spectra close to the center of the spectral population, in this case we don´t look to their value in moisture , protein and so on. Later when we evaluate the statistics of the transfer we van see that the standardization works fine in a certain range of the moisture range and not so well in other ranges, so we have to consider also the values of the moisture content of the sample we use for the standardization.

In this case we compare the results of two instrument standardized without taking care of the moisture content of the sample/s used for the standardization, and we can see that in the upper range there is a difference and the monitor function recommends a slope adjustment. We can adjust the slope after the standardization but the idea would be to try other standardization using samples in the moisture range and to check a better performance doing this monitor validation again.

Working with the Shootout 2016 data with R (Part 2)

One of the samples in the instrument A2 is a clear outlier and should be removed. Before to proceed we have to apply a math treatment to remove the scatter so we can compare better the spectra of the same samples scanned on the 3 instruments of the same manufacturers, in this case with the instruments A1 , A2 and A3 of the manufacturer A.

 I choose in this case MSC. After applying the MSC I could overplot the spectra of all these instruments, but we won´t see clearly the differences, so the best way to see the spectral differences is to substract the spectra from the samples scanned on one instrument from the spectra of samples scanned in the others, so in this case I can subtract A1 –A2, A1 – A3 and A2 – A3, and to look to the patterns of the spectra.

We can see that when instrument A2 is involved strange difference spectra appears, so this sample will be removed from all the calibration sets from instruments of Manufacturer A.

CalA1A2<-CalSetA1_tC_spec_msc - CalSetA2_tC_spec_msc
    matplot(wavelengths_C,t(CalA1A2),lty=1,type="l",
    + pch=NULL,xlab="nm",ylab="abs",col="red",main="A1-A2")

CalA1A3<-CalSetA1_tC_spec_msc - CalSetA3_tC_spec_msc
    matplot(wavelengths_C,t(CalA1A3),lty=1,type="l",
    + pch=NULL,xlab="nm",ylab="abs",col="red",main="A1 - A3")

CalA2A3<-CalSetA2_tC_spec_msc - CalSetA3_tC_spec_msc
    matplot(wavelengths_C,t(CalA2A3),lty=1,type="l",
     + pch=NULL,xlab="nm",ylab="abs",col="red",main="A2 - A3")

 

 

Working with the Shootout 2016 data with R (Part 1)

wavelengths_A<-seq(from=730,to=1100,by=0.5)

wavelengths_B<-seq(from=570,to=1100,by=0.5)

wavelengths_C<-seq(from=850,to=1048,by=2)

######  WORKING WITH "MANUFACTURER A" DATA #########################

### A1 Instrument

CalSetA1_spec<-as.matrix(CalSetA1[,3:743])              #Defining the spectra range

    matplot(wavelengths_A,t(CalSetA1_spec),lty=1,type="l",

        pch=NULL,xlab="nm",ylab="abs",ylim=c(-0.5,6),col="red")

colsC<-seq(from=1,to=637,by=4)               #to convert from 0.5 to 2.0 nm

CalSetA1_2nm_spec<-CalSetA1_spec[,colsC]     # A1 with 2nm interval

CalSetA1_tC_spec<-CalSetA1_2nm_spec[,61:160] # A1 trimmed to C

    matplot(wavelengths_C,t(CalSetA1_tC_spec),lty=1,type="l",

        pch=NULL,xlab="nm",ylab="abs",ylim=c(-0.5,4),col="blue")

   

### A2 Instrument

CalSetA2_spec<-as.matrix(CalSetA2[,3:743])

    matplot(wavelengths_A,t(CalSetA2_spec),lty=1,type="l",

        pch=NULL,xlab="nm",ylab="abs",ylim=c(-0.5,6),col="red")

CalSetA2_2nm_spec<-CalSetA2_spec[,colsC]     # A2 with 2nm interval

CalSetA2_tC_spec<-CalSetA2_2nm_spec[,61:160] # A2 trimmed to C

    matplot(wavelengths_C,t(CalSetA2_tC_spec),lty=1,type="l",

        pch=NULL,xlab="nm",ylab="abs",ylim=c(-0.5,4),col="blue")

### A3 Instrument

CalSetA3_spec<-as.matrix(CalSetA3[,3:743])

    matplot(wavelengths_A,t(CalSetA3_spec),lty=1,type="l",

        pch=NULL,xlab="nm",ylab="abs",ylim=c(-0.5,6),col="red")

CalSetA3_2nm_spec<-CalSetA3_spec[,colsC]     # A3 with 2nm interval

CalSetA3_tC_spec<-CalSetA3_2nm_spec[,61:160] # A3 trimmed to C

    matplot(wavelengths_C,t(CalSetA3_tC_spec),lty=1,type="l",

        pch=NULL,xlab="nm",ylab="abs",ylim=c(-0.5,4),col="blue")

 This is the plot of the spectra in the calibration set for Manufacturer A scanned on the instruments A1, A2 and A3.

 This is the plot of the spectra in the calibration set for Manufacturer A scanned on the instruments A1, A2 and A3 timmed to the range of C (instrument with the lower range) .