Count number of columns by a condition (>) for each row

Question

I am trying to work out for each row of a matrix how many columns have values greater than a specified value. I am sorry that I am asking this simple question but I wasn't able to figure it out.

I have extracted maximum temperature values from a raster stack, of multiple years of rasters, for some spatial points I am interested in. The data looks similar to:

data <- cbind('1990' = c(25, 22, 35, 42, 44), '1991' = c(23, 28, 33, 40, 45), '1992' = c(20, 20, 30, 41, 43))

    1990   1991   1992
1     25     23     20
2     22     28     20
3     35     33     30
4     42     40     41
5     44     45     43

I want to end up with the number of years that the temperature was above 30 for each location, eg.:

    yr.above   
1          0
2          0
3          2
4          3
5          3

I have tried a few things but they didn't work and were pretty illogical (e.g. trying length(data[1:length(data), which(blah blah doesn't make sense)), or apply(data, 1, length(data) > 30), I know these don't make sense but I am a bit stuck.

Hexahydrate

Answer 1

This will give you the vector you are looking for:

rowSums(data > 30)

It will work whether data is a matrix or a data.frame. Also, it uses vectorized functions, hence is a preferred approach over using apply which is little more than a (slow) for loop.

If data is a data.frame, you can add the result as a column by doing:

data$yr.above <- rowSums(data > 30)

or if data is a matrix:

data <- cbind(data, yr.above = rowSums(data > 30))

You can also create a whole new data.frame:

data.frame(yr.above = rowSums(data > 30))

or a whole new matrix:

cbind(yr.above = rowSums(data > 30))

Farnesol

+1, though note that data in the op's example is a matrix not a data.frame – Trever

Thanks. It is hard to tell: cbind does give a matrix, but the printed data in the question suggests a data.frame. I have edited to address both possibilities. – Farnesol

Perfect! Thanks flodel. I purposefully didn't look at rowSums because I thought it would give me a sum of all the values above 30. In fact I have been using rowSums to get the summed value of my rows for a different variable... Live and learn. Cheers – Hexahydrate

You are very welcome. The idea is that data > 30 returns a matrix of TRUE and FALSE. When you apply rowSums on that matrix, the TRUE and FALSE are converted into 1 and 0 respectively. – Farnesol

Answer 2

The third argument of apply needs to be a function. Also, you can count logical trues with sum.

apply(data, 1, function(x)sum(x > 30))

Zoology

Also, apply(data>30,1,sum) ! – Declaration

Answer 3

We can also do with Reduce and + (assuming there are no NA elements)

 Reduce(`+`, lapply(as.data.frame(data), `>`, 30))

This should be efficient as we are not converting to a matrix.

Ghost

Answer 4

With dplyr package, you can try the following two solutions.

library(dplyr)
df <- as.data.frame(data)

Options 1

df %>%
  mutate(yr.above = rowSums(across(`1990`:`1992`) > 30))

Options 2

After dplyr 1.0.0, you can use c_across() with rowwise() to make it easy to perform row-wise aggregations.

df %>%
  rowwise() %>%
  mutate(yr.above = sum(c_across(`1990`:`1992`) > 30)) %>%
  ungroup()

Note: One of the benefits for using dplyr is the support of tidy selections, which provide a concise dialect of R for selecting variables based on their names or properties.

---

Output

# # A tibble: 5 x 4
#   `1990` `1991` `1992` yr.above
#    <dbl>  <dbl>  <dbl>    <int>
# 1     25     23     20        0
# 2     22     28     20        0
# 3     35     33     30        2
# 4     42     40     41        3
# 5     44     45     43        3

Logue